-- Logs begin at Sun 2022-09-25 03:56:06 UTC, end at Sun 2022-09-25 05:00:07 UTC. -- Sep 25 04:27:12.937014 dv-cinder-855359-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 25 04:27:12.946598 dv-cinder-855359-5-iscsi devstack@n-api.service[105642]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 25 04:27:12.948219 dv-cinder-855359-5-iscsi devstack@n-api.service[105642]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Sep 25 04:27:12 2022] *** Sep 25 04:27:12.948219 dv-cinder-855359-5-iscsi devstack@n-api.service[105642]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 25 04:27:12.948219 dv-cinder-855359-5-iscsi devstack@n-api.service[105642]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 25 04:27:12.948219 dv-cinder-855359-5-iscsi devstack@n-api.service[105642]: nodename: dv-cinder-855359-5-iscsi Sep 25 04:27:12.948219 dv-cinder-855359-5-iscsi devstack@n-api.service[105642]: machine: x86_64 Sep 25 04:27:12.948219 dv-cinder-855359-5-iscsi devstack@n-api.service[105642]: clock source: unix Sep 25 04:27:12.948219 dv-cinder-855359-5-iscsi devstack@n-api.service[105642]: pcre jit disabled Sep 25 04:27:12.948219 dv-cinder-855359-5-iscsi devstack@n-api.service[105642]: detected number of CPU cores: 4 Sep 25 04:27:12.948219 dv-cinder-855359-5-iscsi devstack@n-api.service[105642]: current working directory: / Sep 25 04:27:12.948219 dv-cinder-855359-5-iscsi devstack@n-api.service[105642]: detected binary path: /usr/bin/uwsgi-core Sep 25 04:27:12.948219 dv-cinder-855359-5-iscsi devstack@n-api.service[105642]: your processes number limit is 47680 Sep 25 04:27:12.948219 dv-cinder-855359-5-iscsi devstack@n-api.service[105642]: your memory page size is 4096 bytes Sep 25 04:27:12.948219 dv-cinder-855359-5-iscsi devstack@n-api.service[105642]: detected max file descriptor number: 2048 Sep 25 04:27:12.948219 dv-cinder-855359-5-iscsi devstack@n-api.service[105642]: lock engine: pthread robust mutexes Sep 25 04:27:12.949228 dv-cinder-855359-5-iscsi devstack@n-api.service[105642]: thunder lock: enabled Sep 25 04:27:12.949228 dv-cinder-855359-5-iscsi devstack@n-api.service[105642]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 25 04:27:12.949228 dv-cinder-855359-5-iscsi devstack@n-api.service[105642]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 25 04:27:12.988550 dv-cinder-855359-5-iscsi devstack@n-api.service[105642]: Python main interpreter initialized at 0x562481fdd9c0 Sep 25 04:27:12.988550 dv-cinder-855359-5-iscsi devstack@n-api.service[105642]: python threads support enabled Sep 25 04:27:12.988550 dv-cinder-855359-5-iscsi devstack@n-api.service[105642]: your server socket listen backlog is limited to 100 connections Sep 25 04:27:12.988550 dv-cinder-855359-5-iscsi devstack@n-api.service[105642]: your mercy for graceful operations on workers is 90 seconds Sep 25 04:27:12.988902 dv-cinder-855359-5-iscsi devstack@n-api.service[105642]: mapped 403077 bytes (393 KB) for 2 cores Sep 25 04:27:12.988986 dv-cinder-855359-5-iscsi devstack@n-api.service[105642]: *** Operational MODE: preforking *** Sep 25 04:27:12.989229 dv-cinder-855359-5-iscsi devstack@n-api.service[105642]: *** uWSGI is running in multiple interpreter mode *** Sep 25 04:27:12.989229 dv-cinder-855359-5-iscsi devstack@n-api.service[105642]: spawned uWSGI master process (pid: 105642) Sep 25 04:27:12.989427 dv-cinder-855359-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 25 04:27:12.990137 dv-cinder-855359-5-iscsi devstack@n-api.service[105642]: spawned uWSGI worker 1 (pid: 105643, cores: 1) Sep 25 04:27:12.990284 dv-cinder-855359-5-iscsi devstack@n-api.service[105642]: spawned uWSGI worker 2 (pid: 105644, cores: 1) Sep 25 04:27:12.991167 dv-cinder-855359-5-iscsi devstack@n-api.service[105642]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 25 04:27:13.659477 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 25 04:27:13.660090 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 25 04:27:14.748693 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 25 04:27:14.748693 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: from cryptography.utils import int_from_bytes Sep 25 04:27:14.749266 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 25 04:27:14.749266 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: from cryptography.utils import int_from_bytes Sep 25 04:27:14.752118 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 25 04:27:14.752118 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: from cryptography.utils import int_from_bytes Sep 25 04:27:14.752544 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 25 04:27:14.752544 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: from cryptography.utils import int_from_bytes Sep 25 04:27:17.325210 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 25 04:27:17.325777 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 25 04:27:17.325924 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 25 04:27:17.326366 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 25 04:27:17.326477 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 25 04:27:17.326573 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 25 04:27:17.326573 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 25 04:27:17.326741 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 25 04:27:17.326942 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.327052 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 25 04:27:17.327269 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.327367 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 25 04:27:17.327592 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.327679 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.327913 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.328027 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.328243 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.328334 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.328553 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.328684 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.328901 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.328991 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.329483 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.329587 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.329813 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.329910 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.330073 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.330189 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.330386 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.330487 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.330702 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.330801 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855359-5-iscsi {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.331020 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.331109 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.331325 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.331412 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855359-5-iscsi {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.331633 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.331736 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.331959 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.332067 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.332264 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.332383 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.332582 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.332709 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.332913 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.333009 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.333247 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.333432 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.333561 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.334558 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.334669 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.334753 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.334824 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.334901 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.334971 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.335045 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.335114 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.335180 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.335370 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.335478 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.335600 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.335699 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.335910 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.336005 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.336247 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.336385 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.336550 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.336666 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.336903 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.337014 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855359-5-iscsi {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.337216 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.337325 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.337592 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.337700 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855359-5-iscsi {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.337959 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.338127 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.338293 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.338558 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.338708 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.338878 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.339096 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.339187 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.339414 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.339511 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.339730 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.339818 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.340057 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.340153 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.340384 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.340481 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.340718 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.340813 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.341054 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.341151 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.341381 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.341471 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.341684 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.341777 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.341999 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.342087 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.342310 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.342397 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.342622 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.342717 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.342926 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.343026 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.343233 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.343330 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.343483 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.343571 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.343794 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.343978 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.344082 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.344186 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.344393 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.344483 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.344740 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.344845 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.345059 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.345149 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.345310 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.345407 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.345623 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.345711 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.345876 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.345964 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.346199 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.346312 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.346528 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.346629 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.346833 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.346919 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.347140 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.347237 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.347448 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.347541 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.347752 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.347858 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.348059 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.348154 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.348363 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.348456 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.348687 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.348790 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.349001 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.349104 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.349322 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.349414 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.349632 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.349720 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.349954 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.350044 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.350262 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.350355 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.350587 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.350680 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.350891 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.350988 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.351226 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.351322 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.351539 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.351627 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.351848 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.351935 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.352166 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.352256 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.352484 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.352573 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.352814 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.352917 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.353122 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.353210 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.353975 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.354089 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.354300 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.354456 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.354624 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.354714 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.354929 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.355031 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.355176 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.355320 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.355476 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.355632 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.355781 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.355881 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.356099 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.356188 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.356405 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.356513 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.356733 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.356877 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.357041 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.357192 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.357342 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.357504 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.357648 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.357813 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.357954 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.358100 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.358260 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.358413 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.358563 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.358722 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.358868 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.359032 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.359172 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.359342 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.359473 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.359649 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.359780 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.359956 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.360084 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.360261 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.360387 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.360571 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.360727 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.360905 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.361050 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.361212 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.361356 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.361534 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.361667 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.361860 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.361972 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.362170 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.362267 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.362481 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.362571 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.362796 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.362885 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.363106 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.363204 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.363430 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.363526 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.363740 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.363829 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.364053 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.364177 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.364369 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.364463 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.364694 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.364800 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.365004 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.365107 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.365323 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.365416 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.365624 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.365718 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.365930 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.366030 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.366250 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.366348 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.366555 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.366670 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.366865 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.366966 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.367165 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.367256 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.367468 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.367561 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.367771 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.367875 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.368080 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.368174 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.368375 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.368479 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.368697 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.368789 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.369064 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.369713 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.369879 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.370018 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.370190 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.370364 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.370495 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.370679 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.370816 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.370990 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.371140 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.371298 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.371450 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.371626 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.371760 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.371965 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.372055 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.372299 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.372389 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:27:17.372669 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.372778 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.372989 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.373081 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.373327 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.373418 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.373662 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.373761 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.373982 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.374090 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.374297 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.374388 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.374614 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.374715 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.374945 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.375049 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.375258 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.375348 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.375570 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.375666 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.375886 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.376000 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.376199 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.376300 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.376516 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.376654 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.376867 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.376974 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.377187 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.377279 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.377506 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.377608 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.377826 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.377917 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.378138 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.378237 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.378457 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.378550 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.378772 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.378873 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.379091 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.379184 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.379403 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.379504 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.379736 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.379827 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.380055 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.380158 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.380385 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.380477 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.380735 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.380830 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.381057 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.381151 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.381371 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.381471 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.381689 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.381783 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.382000 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.382112 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.382320 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.382412 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.382637 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.382743 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.382957 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.383062 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.383280 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.383361 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.383595 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.383692 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.383920 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.384017 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.384237 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.384341 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.384581 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.384738 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.385044 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.385147 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.385391 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.385515 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.385711 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.385835 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.386032 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.386178 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.386351 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.386499 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.386693 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.386842 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.387015 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.387149 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.387346 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.387466 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.387669 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.387789 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.387989 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.388106 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.388312 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.388409 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.388657 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.388773 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.388990 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.389082 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.389308 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.389397 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.389623 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.389710 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.389935 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.390032 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.390247 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.390336 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.390564 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.390662 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.390878 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.390978 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.391195 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.391282 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.391527 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.391624 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.391838 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.391926 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.392154 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.392243 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.392467 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.392570 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.392806 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.392908 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.393119 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.393209 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.393432 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.393532 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.393743 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.393838 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.394053 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.394142 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.394367 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.394454 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.394679 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.394775 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.394985 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.395073 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.395314 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.395405 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.395623 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.395709 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.395931 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.396017 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.396251 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.396339 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.396564 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.396693 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.396904 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.396991 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.397222 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.397311 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.397534 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.397677 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.397853 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.397950 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.398166 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.398261 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.398481 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.398579 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.398800 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.398912 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.399115 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.399212 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.399437 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.399525 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.399767 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.399866 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.400077 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.400165 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.400589 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.400705 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.400932 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.401055 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.401251 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.401355 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.401563 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.401652 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.401874 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.402065 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.402185 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.402274 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.402497 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.402594 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.402808 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.402898 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.403117 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.403208 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.403427 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.403523 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.403735 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.403833 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.404042 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.404131 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.404353 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.404440 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.404683 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.404775 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.404995 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.405086 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.405301 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.405407 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.405606 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.405696 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.405914 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.406001 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.406226 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.406329 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.406577 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.406666 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.406888 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.406984 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.407218 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.407315 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.407544 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.407633 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.407858 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.407947 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.408175 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.408274 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.408486 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.408576 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.408826 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.408933 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.409141 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.409236 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.409454 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.409548 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.409768 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.409860 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.410078 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.410170 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.410399 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.410500 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.410709 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.410802 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.411030 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.411122 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.411341 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.411432 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.411667 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.411758 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.411972 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.412064 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.412288 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.412381 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.412597 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.412712 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.412941 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.413034 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.413281 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.413376 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.413608 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.413711 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.413922 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.414016 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.414238 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.414331 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.414569 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.414673 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.414863 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.414956 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.415174 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.415267 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.415485 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.415588 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.416297 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.416400 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.416652 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.416757 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.416974 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.417077 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.417286 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.417392 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.417610 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.417701 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.417920 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.418025 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.418239 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.418330 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.418544 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.418635 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.418859 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.419012 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.419190 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.419287 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.419509 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.419597 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.419828 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.419916 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.420142 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.420231 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.420466 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.420556 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.420801 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.420895 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.421120 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.421233 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.421432 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.421533 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.421739 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.421840 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.422052 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.422151 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.422360 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.422465 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.422673 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.422764 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.422982 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.423075 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.423294 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.423409 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.423600 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.423689 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.423910 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.424006 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.424222 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.424319 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.424527 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.424624 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.424855 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.424945 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.425167 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.425332 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.425478 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.425568 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.425787 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.425889 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.426113 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.426225 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.426428 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.426515 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.426734 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.426823 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.427039 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.427130 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.427367 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.427468 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.427675 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.427775 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.427979 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.428087 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.428285 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.428375 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.428591 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.428711 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.428939 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.429029 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.429251 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.429342 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.429555 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.429652 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.429875 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.429964 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.430197 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.430284 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.430510 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.430606 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.430826 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.430917 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.431137 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.431248 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.431508 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.432108 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.432377 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.432491 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.432627 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.432756 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.432976 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.433075 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.433290 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.433378 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.433603 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.433692 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.433917 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.434005 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.434230 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.434318 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.434547 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.434637 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.434860 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.434956 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.435176 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.435266 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.435487 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.435573 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.435793 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.435882 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.436106 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.436193 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.436417 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.436512 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.436755 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.437013 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.437111 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.437355 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.437635 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.437751 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.437976 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.438066 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.438298 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.438388 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.438624 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.438722 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.438956 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.439053 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.439285 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.439386 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.439599 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.439687 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.439910 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.439999 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.440225 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.440317 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.440533 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.440622 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.440868 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.440971 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.441180 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.441269 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.441490 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.441609 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.441804 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.441919 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.442109 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.442206 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.442420 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.442519 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.442729 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.442831 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.443035 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.443133 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.443343 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.443480 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.443651 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.443749 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.443956 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.444052 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.444261 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.444350 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.444576 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.444699 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.444909 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.444999 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.445227 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.445314 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.445538 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.445628 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.445844 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.445935 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.446149 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.446246 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.446453 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.446544 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.446760 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.446847 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.447089 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.447184 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.447441 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.447744 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.447842 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.448085 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.448173 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.448423 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.448514 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.448765 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.448858 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.449082 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.449173 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.449398 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.449494 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.449714 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.449808 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.450026 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.450115 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.450335 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.450432 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.450646 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.450737 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.450956 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.451051 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.451266 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.451363 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.451579 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.451695 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.451894 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.452005 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.452203 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.452291 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.452514 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.452601 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.452847 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.452956 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.453156 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.453243 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.453461 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.453548 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.453768 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.453866 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.454081 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.454422 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.454644 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.454740 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.454951 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.455050 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.455258 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.455346 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.455566 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.455656 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.455873 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.455963 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.456180 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.456267 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.456484 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.456573 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.456815 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.456914 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.457126 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.457227 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.457434 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.457532 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.457741 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.457832 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.458048 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.458136 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.458356 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.458443 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.458664 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.458754 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.458972 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.459059 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.459290 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.459391 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.459598 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.459687 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.459904 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.459993 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.460212 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.460307 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.460516 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.460605 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.460845 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.460937 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.461152 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.461257 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.461469 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.461560 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.461786 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.461890 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.462101 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.462211 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.462409 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.462499 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.463239 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.463334 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.463552 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.463806 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.463906 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.463992 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.464161 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.464250 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.464473 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.464564 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.464811 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.464922 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.465122 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.465214 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.465434 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.465527 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.465744 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.465842 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.466056 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.466150 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.466372 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.466472 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.466680 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.466773 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.466988 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.467092 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.467294 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.467394 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.467656 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.467752 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.467937 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.468033 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.468254 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.468355 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.468592 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.468709 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.468933 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.469040 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.469252 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.469343 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.469603 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.469707 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.469878 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.470017 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.470188 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.470282 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.470493 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.470583 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.470804 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.470894 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.471114 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.471203 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.471427 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.471517 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.471732 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.471873 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.472043 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.472146 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.472356 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.472459 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.472682 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.472823 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.472998 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.473088 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.473323 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.473413 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.473648 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.473775 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.473973 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.474088 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.474283 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.474401 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.474596 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.474714 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.474906 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.475019 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.475212 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.475335 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.475520 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.475643 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.475830 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.475988 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.476144 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.476267 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.476456 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.476578 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.476795 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.476910 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.477109 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.477242 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.477422 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.477538 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.477732 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.477847 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.478041 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.478166 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.478488 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.478659 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.478807 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.478967 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.479118 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.479236 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.479321 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.479404 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.479628 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.479839 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.479933 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.480023 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.480234 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.480324 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.480541 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.480669 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.480873 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.480961 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.481185 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.481314 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.481629 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.481732 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.481948 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.482038 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.482255 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.482360 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.482572 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.482673 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.482880 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.482968 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.483195 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.483292 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.483510 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.483599 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.483817 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.483917 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.484127 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.484244 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.484558 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.484681 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.484896 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.484988 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.485212 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.485302 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.485520 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.485619 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.485827 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.485918 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.486138 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.486236 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.486455 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.486545 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.486761 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.486849 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.487069 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.487167 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.487374 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.487473 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.487682 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.487770 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.487991 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.488094 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.488310 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.488397 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.488655 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.488748 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.489055 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.489162 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.489365 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.489456 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.489693 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.489780 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.490089 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.490181 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.490402 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.490492 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.490729 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.490902 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.491055 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.491146 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.491383 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.491481 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.491689 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.491780 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.492043 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.492218 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.492320 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.492405 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.492653 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.492769 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.492984 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.493095 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.493299 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.493391 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.493615 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.493704 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.494441 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.494606 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.494826 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.495061 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.495159 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.495243 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.495461 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.495561 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.495787 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.495877 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.496130 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.496226 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.496524 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.496622 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.496865 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.496968 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.497192 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.497282 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.497523 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.497622 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.497833 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.497923 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.498142 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.498231 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.498456 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.498553 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.498760 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.498849 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.499067 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.499164 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.499379 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.499468 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.499689 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.499778 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.500002 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.500091 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.500315 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.500407 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.500626 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.500775 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.500953 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.501055 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.501261 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.501352 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.501570 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.501660 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.501880 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.501967 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.502200 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.502290 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.502520 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.502610 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.502841 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.502951 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.503159 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.503248 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.503467 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.503557 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.503785 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.503884 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.504095 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.504183 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.504402 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.504492 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.504730 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.504842 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.505039 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.505130 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.505346 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.505435 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.505682 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.505780 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.505995 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.506083 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.506322 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.506419 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.506652 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.506742 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.506968 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.507058 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.507286 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.507382 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.507623 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.507720 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.507948 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.508038 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.508263 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.508353 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.508576 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.508679 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.508946 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.509049 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.509237 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.509339 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.509571 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.509690 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.509967 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.510107 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.510256 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.510355 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.510568 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.510658 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.510879 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.510968 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.511191 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.511294 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.511504 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.511606 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.511814 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.511904 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.512124 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.512227 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.512433 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.512524 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.512778 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.512898 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.513100 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.513214 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.513416 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.513505 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.513726 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.513817 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.514036 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.514127 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.514344 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.514443 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.514655 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.514746 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.514988 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.515078 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.515308 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.515396 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.515620 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.515717 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.515947 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.516043 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.516267 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.516357 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.516586 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.516704 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.516936 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.517026 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.517258 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.517348 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.517580 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.517682 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.517901 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.518001 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.518223 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.518313 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.518536 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.518677 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.518847 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.518936 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.519164 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.519254 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.519484 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.519582 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.519809 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.520018 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.520347 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.520437 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.520686 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.520857 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.521008 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.521099 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.521324 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.521420 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.521641 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.521731 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.521959 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.522047 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.522275 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.522418 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.522590 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.522680 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.522899 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.522988 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.523215 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.523316 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.523528 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.523618 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.523853 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.523942 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.524182 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.524281 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.524515 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.524605 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.524871 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.524961 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.525717 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.525834 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.526066 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.526387 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.526478 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.526717 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.526815 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.527048 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.527146 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.527357 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.527446 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.527675 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.527779 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.527994 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.528092 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.528310 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.528400 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.528621 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.528763 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.528958 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.529049 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.529278 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.529380 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.529597 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.529687 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.529907 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.530004 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.530222 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.530359 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.530537 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.530628 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.530850 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.530938 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.531167 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.531264 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.531489 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.531580 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.531813 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.531902 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.532131 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.532234 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.532451 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.532562 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.532798 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.532893 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.533119 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.533321 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.533436 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.533642 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.533961 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.534071 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.534285 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.534388 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.534613 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.534707 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.534932 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.535026 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.535252 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.535347 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.535574 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.535666 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.535884 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.535984 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.536194 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.536289 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.536506 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.536599 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.536842 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.536936 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.537153 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.537255 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.537467 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.537567 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.537779 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.537872 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.538087 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.538188 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.538407 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.538500 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.538715 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.538840 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.539039 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.539245 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.539339 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.539593 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.539874 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.539981 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.540224 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.540337 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.540545 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.540659 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.540961 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.541070 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.541460 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.541741 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.541832 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.541915 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.542129 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.542222 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.542463 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.542570 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.542779 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.542880 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.543089 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.543181 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.543422 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.543518 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.543734 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.543830 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.544015 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.544115 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.544325 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.544419 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.544652 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.544754 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.544967 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.545059 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.545274 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.545365 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.545589 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.545698 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.545900 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.545992 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.546206 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.546296 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.546514 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.546615 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.546830 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.546920 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.547135 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.547226 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.547445 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.547545 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.547754 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.547844 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.548060 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.548149 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.548369 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.548468 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.548696 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.548789 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.549012 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.549102 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.549320 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.549422 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.549632 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.549731 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.549941 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.550031 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.550258 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.550349 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.550582 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.550671 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.550910 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.551001 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.551221 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.551313 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.551529 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.551620 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.551846 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.551935 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.552156 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.552246 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.552475 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.552566 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.552815 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.552977 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.553140 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.553284 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.553446 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.553615 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.553768 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.553874 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.554125 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.554298 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.554444 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.554638 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.554960 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.555063 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.555299 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.555397 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.555622 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.555711 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.555964 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.556063 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.556273 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.556362 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.557154 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.557260 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.557548 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.557640 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.557865 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.557956 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.558196 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.558295 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.558517 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.558609 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.558834 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.558922 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.559150 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.559251 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.559461 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.559552 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.559776 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.559864 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.560087 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.560176 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.560401 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.560494 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.560739 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.560842 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.561051 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.561152 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.561362 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.561461 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.561674 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.561765 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.561986 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.562084 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.562303 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.562396 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.562619 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.562716 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.562941 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.563045 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.563259 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.563348 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.563580 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.563718 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.563900 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.563994 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.564213 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.564304 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.564527 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.564628 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.564865 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.564966 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.565179 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.565267 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.565493 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.565583 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.565809 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.565908 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.566129 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.566219 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.566434 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.566531 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.566771 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.567083 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.567173 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.567420 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.567746 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.567845 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.568075 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.568174 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.568392 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.568482 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.568742 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.568848 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.569065 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.569170 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.569379 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.569480 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.569702 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.569794 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.570015 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.570105 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.570345 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.570435 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.570661 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.570773 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.571000 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.571110 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.571323 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.571413 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.571633 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.571725 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.571943 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.572034 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.572875 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.573153 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.573352 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.573477 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.573673 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.573811 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.573993 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.574093 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.574320 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.574417 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.574645 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.574737 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.574959 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.575062 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.575315 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.575420 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.575585 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.575675 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.575890 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.575987 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.576198 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.576302 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.576507 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.576596 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.576842 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.576934 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.577150 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.577250 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.577459 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.577547 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.577765 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.577854 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.578072 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.578168 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.578376 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.578464 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.578682 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.578772 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.578984 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.579073 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.579547 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.579657 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.579849 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.579948 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.580156 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.580245 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.580460 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.580557 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.580792 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.580883 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.581105 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.581206 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.581444 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.581552 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.581777 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.581866 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.582093 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.582183 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.582420 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.582588 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.582733 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.582830 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.583059 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.583155 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.583376 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.583479 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.583691 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.583779 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.584006 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.584098 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.584328 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.584418 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.584662 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.584754 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.584976 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.585067 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.585292 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.585385 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.585606 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.585698 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.585919 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.586010 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.586232 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.586321 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.586549 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.586641 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.586865 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.586965 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.587172 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.587261 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.587501 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.587590 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.587842 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.587945 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.588174 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.588265 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.588491 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.588579 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.588828 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.588933 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.589150 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.589240 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.589461 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.589566 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.589778 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.589888 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.590088 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.590187 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.590402 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.590491 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.590711 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.590801 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.591024 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.591127 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.591336 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.591435 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.591647 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.591739 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.591965 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.592068 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.592280 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.592379 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.592603 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.592750 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.592959 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.593060 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.593275 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.593376 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.593605 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.593699 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.593914 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.594056 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.594247 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.594349 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.594575 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.594664 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.594922 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.595015 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.595239 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.595336 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.595555 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.595645 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.595872 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.595962 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.596181 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.596279 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.596421 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 25 04:27:17.596519 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.596849 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:27:17.597095 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 25 04:27:17.750074 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO dbcounter [None req-2e45461a-a223-483b-b518-840b745f9859 None None] Registered counter for database nova_api Sep 25 04:27:17.750603 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO dbcounter [None req-f822b681-ec1c-4201-b959-86a546d01765 None None] Registered counter for database nova_api Sep 25 04:27:17.772534 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG oslo_db.sqlalchemy.engines [None req-2e45461a-a223-483b-b518-840b745f9859 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 04:27:17.774200 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG oslo_db.sqlalchemy.engines [None req-f822b681-ec1c-4201-b959-86a546d01765 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105644) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 04:27:17.779923 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG dbcounter [-] [105643] Writer thread running {{(pid=105643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 04:27:17.781345 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG dbcounter [-] [105644] Writer thread running {{(pid=105644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 04:27:17.857189 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.context [None req-2e45461a-a223-483b-b518-840b745f9859 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),adc1fa50-82a8-468b-9dc8-c203e45a28ca(cell1) {{(pid=105643) load_cells /opt/stack/nova/nova/context.py:464}} Sep 25 04:27:17.861055 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG oslo_concurrency.lockutils [None req-2e45461a-a223-483b-b518-840b745f9859 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:27:17.861527 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG oslo_concurrency.lockutils [None req-2e45461a-a223-483b-b518-840b745f9859 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:27:17.862909 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.context [None req-f822b681-ec1c-4201-b959-86a546d01765 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),adc1fa50-82a8-468b-9dc8-c203e45a28ca(cell1) {{(pid=105644) load_cells /opt/stack/nova/nova/context.py:464}} Sep 25 04:27:17.863209 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG oslo_concurrency.lockutils [None req-2e45461a-a223-483b-b518-840b745f9859 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:27:17.863928 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG oslo_concurrency.lockutils [None req-2e45461a-a223-483b-b518-840b745f9859 None None] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:27:17.864369 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG oslo_concurrency.lockutils [None req-2e45461a-a223-483b-b518-840b745f9859 None None] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:27:17.866532 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG oslo_concurrency.lockutils [None req-2e45461a-a223-483b-b518-840b745f9859 None None] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:27:17.866765 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG oslo_concurrency.lockutils [None req-f822b681-ec1c-4201-b959-86a546d01765 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:27:17.867237 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG oslo_concurrency.lockutils [None req-f822b681-ec1c-4201-b959-86a546d01765 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:27:17.868620 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO dbcounter [None req-2e45461a-a223-483b-b518-840b745f9859 None None] Registered counter for database nova_cell0 Sep 25 04:27:17.869030 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG oslo_concurrency.lockutils [None req-f822b681-ec1c-4201-b959-86a546d01765 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:27:17.869768 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG oslo_concurrency.lockutils [None req-f822b681-ec1c-4201-b959-86a546d01765 None None] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:27:17.870211 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG oslo_concurrency.lockutils [None req-f822b681-ec1c-4201-b959-86a546d01765 None None] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:27:17.872328 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG oslo_concurrency.lockutils [None req-f822b681-ec1c-4201-b959-86a546d01765 None None] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:27:17.874448 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO dbcounter [None req-f822b681-ec1c-4201-b959-86a546d01765 None None] Registered counter for database nova_cell0 Sep 25 04:27:17.874635 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO dbcounter [None req-2e45461a-a223-483b-b518-840b745f9859 None None] Registered counter for database nova_cell1 Sep 25 04:27:17.878657 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO dbcounter [None req-f822b681-ec1c-4201-b959-86a546d01765 None None] Registered counter for database nova_cell1 Sep 25 04:27:17.883929 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG oslo_db.sqlalchemy.engines [None req-2e45461a-a223-483b-b518-840b745f9859 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 04:27:17.885883 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG oslo_db.sqlalchemy.engines [None req-2e45461a-a223-483b-b518-840b745f9859 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 04:27:17.886294 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG oslo_db.sqlalchemy.engines [None req-f822b681-ec1c-4201-b959-86a546d01765 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105644) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 04:27:17.888470 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG oslo_db.sqlalchemy.engines [None req-f822b681-ec1c-4201-b959-86a546d01765 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105644) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 04:27:17.892548 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG dbcounter [-] [105643] Writer thread running {{(pid=105643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 04:27:17.893106 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG dbcounter [-] [105644] Writer thread running {{(pid=105644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 04:27:17.894419 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG dbcounter [-] [105643] Writer thread running {{(pid=105643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 04:27:18.089439 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG dbcounter [-] [105644] Writer thread running {{(pid=105644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 04:27:18.099182 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO dbcounter [None req-2e45461a-a223-483b-b518-840b745f9859 None None] Registered counter for database nova_cell0 Sep 25 04:27:18.100309 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO dbcounter [None req-f822b681-ec1c-4201-b959-86a546d01765 None None] Registered counter for database nova_cell0 Sep 25 04:27:18.107032 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG oslo_db.sqlalchemy.engines [None req-2e45461a-a223-483b-b518-840b745f9859 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 04:27:18.110634 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG oslo_db.sqlalchemy.engines [None req-f822b681-ec1c-4201-b959-86a546d01765 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105644) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 04:27:18.112012 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG dbcounter [-] [105643] Writer thread running {{(pid=105643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 04:27:18.115583 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG dbcounter [-] [105644] Writer thread running {{(pid=105644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 04:27:18.468471 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: WARNING keystonemiddleware.auth_token [None req-2e45461a-a223-483b-b518-840b745f9859 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 25 04:27:18.470841 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: WARNING keystonemiddleware.auth_token [None req-f822b681-ec1c-4201-b959-86a546d01765 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 25 04:27:18.475983 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: WARNING keystonemiddleware.auth_token [None req-2e45461a-a223-483b-b518-840b745f9859 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 25 04:27:18.478972 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: WARNING keystonemiddleware.auth_token [None req-f822b681-ec1c-4201-b959-86a546d01765 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 25 04:27:18.832065 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: WARNING keystonemiddleware.auth_token [None req-2e45461a-a223-483b-b518-840b745f9859 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 25 04:27:18.838828 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: WARNING keystonemiddleware.auth_token [None req-2e45461a-a223-483b-b518-840b745f9859 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 25 04:27:18.840467 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: WARNING keystonemiddleware.auth_token [None req-f822b681-ec1c-4201-b959-86a546d01765 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 25 04:27:18.844272 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562481fdd9c0 pid: 105643 (default app) Sep 25 04:27:18.846397 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-2e45461a-a223-483b-b518-840b745f9859 None None] Calling method '>' {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:27:18.846672 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: WARNING keystonemiddleware.auth_token [None req-f822b681-ec1c-4201-b959-86a546d01765 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 25 04:27:18.847592 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.requestlog [None req-2e45461a-a223-483b-b518-840b745f9859 None None] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001760 Sep 25 04:27:18.848016 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: [pid: 105643|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 788 bytes} [Sun Sep 25 04:27:18 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:27:18.852148 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562481fdd9c0 pid: 105644 (default app) Sep 25 04:28:40.257122 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-2e45461a-a223-483b-b518-840b745f9859 None None] Calling method '>' {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:28:40.258248 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.requestlog [None req-2e45461a-a223-483b-b518-840b745f9859 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001577 Sep 25 04:28:40.258666 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: [pid: 105643|app: 0|req: 2/2] 10.222.0.25 () {54 vars in 931 bytes} [Sun Sep 25 04:28:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:28:40.276691 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG dbcounter [-] [105644] Writing DB stats nova_api:SELECT=3 {{(pid=105644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:40.278163 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG dbcounter [-] [105644] Writing DB stats nova_cell0:SELECT=3 {{(pid=105644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:40.279428 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG dbcounter [-] [105644] Writing DB stats nova_cell1:SELECT=3 {{(pid=105644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:40.280476 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG dbcounter [-] [105644] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:41.161488 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-d22f9ed2-74af-42c7-abd5-da6cd020bfd6 admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:28:41.201659 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-d22f9ed2-74af-42c7-abd5-da6cd020bfd6 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.935939 Sep 25 04:28:41.202495 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 1/3] 10.222.0.25 () {60 vars in 1292 bytes} [Sun Sep 25 04:28:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:28:43.843088 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-2e45461a-a223-483b-b518-840b745f9859 None None] Calling method '>' {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:28:43.844106 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.requestlog [None req-2e45461a-a223-483b-b518-840b745f9859 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Sep 25 04:28:43.845593 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: [pid: 105643|app: 0|req: 3/4] 10.222.0.25 () {54 vars in 931 bytes} [Sun Sep 25 04:28:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:28:44.312848 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-0bd40e8e-3efc-4d26-9c45-2f32a30421ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "name": "cirros256", "ram": 256, "vcpus": 1}} {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:28:44.367061 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-0bd40e8e-3efc-4d26-9c45-2f32a30421ca admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.516340 Sep 25 04:28:44.368466 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 2/5] 10.222.0.25 () {64 vars in 1283 bytes} [Sun Sep 25 04:28:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 25 04:28:44.382043 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG dbcounter [-] [105643] Writing DB stats nova_api:SELECT=3 {{(pid=105643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:44.382863 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG dbcounter [-] [105643] Writing DB stats nova_cell1:SELECT=3 {{(pid=105643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:44.384898 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG dbcounter [-] [105643] Writing DB stats nova_cell0:SELECT=3 {{(pid=105643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:44.385675 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG dbcounter [-] [105643] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:28:44.599761 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-76634738-e275-48b0-8e3f-71d4b23d630c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:28:44.685882 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.requestlog [None req-76634738-e275-48b0-8e3f-71d4b23d630c admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.309109 Sep 25 04:28:44.686734 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: [pid: 105643|app: 0|req: 4/6] 10.222.0.25 () {64 vars in 1336 bytes} [Sun Sep 25 04:28:44 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:28:47.310849 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-0bd40e8e-3efc-4d26-9c45-2f32a30421ca admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:28:47.311873 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-0bd40e8e-3efc-4d26-9c45-2f32a30421ca admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Sep 25 04:28:47.312278 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 3/7] 10.222.0.25 () {54 vars in 931 bytes} [Sun Sep 25 04:28:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:28:48.006182 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-52f3428a-fc65-4be7-a9f1-36ebf82b32be admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "name": "ds512M", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d1", "vcpus": 1, "rxtx_factor": 1.0, "swap": 0}} {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:28:48.065522 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.requestlog [None req-52f3428a-fc65-4be7-a9f1-36ebf82b32be admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.746925 Sep 25 04:28:48.066966 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: [pid: 105643|app: 0|req: 5/8] 10.222.0.25 () {64 vars in 1283 bytes} [Sun Sep 25 04:28:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 04:28:48.081843 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-36bc2474-57b7-467c-b710-a61ec7338db0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:28:48.142757 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-36bc2474-57b7-467c-b710-a61ec7338db0 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.066948 Sep 25 04:28:48.143560 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 4/9] 10.222.0.25 () {64 vars in 1336 bytes} [Sun Sep 25 04:28:48 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:28:50.766805 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-52f3428a-fc65-4be7-a9f1-36ebf82b32be admin admin] Calling method '>' {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:28:50.767845 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.requestlog [None req-52f3428a-fc65-4be7-a9f1-36ebf82b32be admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Sep 25 04:28:50.768259 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: [pid: 105643|app: 0|req: 6/10] 10.222.0.25 () {54 vars in 931 bytes} [Sun Sep 25 04:28:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:28:51.187483 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-4c2fda74-dc2b-461a-b51a-3734b77752cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "id": "d2", "ram": 1024}} {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:28:51.209265 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-4c2fda74-dc2b-461a-b51a-3734b77752cb admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.433874 Sep 25 04:28:51.209754 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 5/11] 10.222.0.25 () {64 vars in 1283 bytes} [Sun Sep 25 04:28:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 04:28:51.222494 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-07c06bcf-b1ab-4079-9edd-3f278fc7e12b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:28:51.253671 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.requestlog [None req-07c06bcf-b1ab-4079-9edd-3f278fc7e12b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035074 Sep 25 04:28:51.254183 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: [pid: 105643|app: 0|req: 7/12] 10.222.0.25 () {64 vars in 1336 bytes} [Sun Sep 25 04:28:51 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:28:53.918904 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-4c2fda74-dc2b-461a-b51a-3734b77752cb admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:28:53.919934 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-4c2fda74-dc2b-461a-b51a-3734b77752cb admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Sep 25 04:28:53.920345 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 6/13] 10.222.0.25 () {54 vars in 931 bytes} [Sun Sep 25 04:28:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:28:54.380913 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-08f1ffb2-6610-497c-8e8a-663c3b424d4d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "disk": 10, "name": "ds2G", "os-flavor-access:is_public": true, "ram": 2048, "vcpus": 2, "id": "d3"}} {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:28:54.402748 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.requestlog [None req-08f1ffb2-6610-497c-8e8a-663c3b424d4d admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.476121 Sep 25 04:28:54.403535 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: [pid: 105643|app: 0|req: 8/14] 10.222.0.25 () {64 vars in 1283 bytes} [Sun Sep 25 04:28:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 04:28:54.415588 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-a0b9e95c-2fe2-469f-be2a-9a9826dc9c1f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:28:54.448816 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-a0b9e95c-2fe2-469f-be2a-9a9826dc9c1f admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036953 Sep 25 04:28:54.450164 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 7/15] 10.222.0.25 () {64 vars in 1336 bytes} [Sun Sep 25 04:28:54 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:28:57.139786 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-08f1ffb2-6610-497c-8e8a-663c3b424d4d admin admin] Calling method '>' {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:28:57.140778 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.requestlog [None req-08f1ffb2-6610-497c-8e8a-663c3b424d4d admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001571 Sep 25 04:28:57.141195 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: [pid: 105643|app: 0|req: 9/16] 10.222.0.25 () {54 vars in 931 bytes} [Sun Sep 25 04:28:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:28:57.575318 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-24d0e43c-0861-4556-8e3b-00f7bf4dc4b8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "swap": 0, "name": "ds4G", "disk": 20, "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:28:57.595700 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-24d0e43c-0861-4556-8e3b-00f7bf4dc4b8 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.448298 Sep 25 04:28:57.596252 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 8/17] 10.222.0.25 () {64 vars in 1283 bytes} [Sun Sep 25 04:28:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 25 04:28:57.610024 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-cebb85ce-662c-452b-8832-3c2065ecaa2a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:28:57.641314 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.requestlog [None req-cebb85ce-662c-452b-8832-3c2065ecaa2a admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036253 Sep 25 04:28:57.642341 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: [pid: 105643|app: 0|req: 10/18] 10.222.0.25 () {64 vars in 1336 bytes} [Sun Sep 25 04:28:57 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:29:00.294128 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-24d0e43c-0861-4556-8e3b-00f7bf4dc4b8 admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:29:00.295168 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-24d0e43c-0861-4556-8e3b-00f7bf4dc4b8 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Sep 25 04:29:00.295589 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 9/19] 10.222.0.25 () {54 vars in 931 bytes} [Sun Sep 25 04:29:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:29:00.725571 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-de16e3ee-592e-4eee-87f2-aa10646d90c2 admin admin] Calling method '>' {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:29:00.756617 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.requestlog [None req-de16e3ee-592e-4eee-87f2-aa10646d90c2 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.454786 Sep 25 04:29:00.757185 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: [pid: 105643|app: 0|req: 11/20] 10.222.0.25 () {60 vars in 1292 bytes} [Sun Sep 25 04:29:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:29:03.373186 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-24d0e43c-0861-4556-8e3b-00f7bf4dc4b8 admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:29:03.374137 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-24d0e43c-0861-4556-8e3b-00f7bf4dc4b8 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Sep 25 04:29:03.374606 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 10/21] 10.222.0.25 () {54 vars in 931 bytes} [Sun Sep 25 04:29:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:29:03.785241 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-4191aaa7-53c1-400d-9c57-8c2e42ac3df7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "name": "m1.tiny", "vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "1", "os-flavor-access:is_public": true}} {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:29:03.804652 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.requestlog [None req-4191aaa7-53c1-400d-9c57-8c2e42ac3df7 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.422944 Sep 25 04:29:03.805159 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: [pid: 105643|app: 0|req: 12/22] 10.222.0.25 () {64 vars in 1283 bytes} [Sun Sep 25 04:29:03 2022] POST /compute/v2.1/flavors => generated 402 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 04:29:03.817382 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-4296a6c5-77be-4b2b-8574-9333335f8140 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:29:03.846732 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-4296a6c5-77be-4b2b-8574-9333335f8140 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033068 Sep 25 04:29:03.847319 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 11/23] 10.222.0.25 () {64 vars in 1333 bytes} [Sun Sep 25 04:29:03 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:29:06.463617 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-4191aaa7-53c1-400d-9c57-8c2e42ac3df7 admin admin] Calling method '>' {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:29:06.464661 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.requestlog [None req-4191aaa7-53c1-400d-9c57-8c2e42ac3df7 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Sep 25 04:29:06.465262 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: [pid: 105643|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 931 bytes} [Sun Sep 25 04:29:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:29:06.902847 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-6274e329-7d5b-4dce-b47a-c76709b298ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "ram": 2048, "os-flavor-access:is_public": true, "disk": 20, "id": "2", "swap": 0, "name": "m1.small"}} {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:29:06.922863 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-6274e329-7d5b-4dce-b47a-c76709b298ea admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.451284 Sep 25 04:29:06.923422 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 12/25] 10.222.0.25 () {64 vars in 1283 bytes} [Sun Sep 25 04:29:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 04:29:06.936024 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-f422fde2-00bd-4c42-bb6d-2134d6a90fa6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:29:06.961776 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.requestlog [None req-f422fde2-00bd-4c42-bb6d-2134d6a90fa6 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029430 Sep 25 04:29:06.964986 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: [pid: 105643|app: 0|req: 14/26] 10.222.0.25 () {64 vars in 1333 bytes} [Sun Sep 25 04:29:06 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:29:09.614553 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-6274e329-7d5b-4dce-b47a-c76709b298ea admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:29:09.615591 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-6274e329-7d5b-4dce-b47a-c76709b298ea admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Sep 25 04:29:09.616003 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 13/27] 10.222.0.25 () {54 vars in 931 bytes} [Sun Sep 25 04:29:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:29:10.056427 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-8fec474b-bcfe-45eb-ac22-6c3061b7f3fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "ram": 4096, "name": "m1.medium", "rxtx_factor": 1.0, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "disk": 40}} {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:29:10.080502 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.requestlog [None req-8fec474b-bcfe-45eb-ac22-6c3061b7f3fd admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.457768 Sep 25 04:29:10.081741 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: [pid: 105643|app: 0|req: 15/28] 10.222.0.25 () {64 vars in 1283 bytes} [Sun Sep 25 04:29:09 2022] POST /compute/v2.1/flavors => generated 406 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 04:29:10.093782 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-2d14a296-b2d9-4380-b513-71b9feddc564 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:29:10.122947 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-2d14a296-b2d9-4380-b513-71b9feddc564 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033012 Sep 25 04:29:10.123540 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 14/29] 10.222.0.25 () {64 vars in 1333 bytes} [Sun Sep 25 04:29:10 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:29:12.801432 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-8fec474b-bcfe-45eb-ac22-6c3061b7f3fd admin admin] Calling method '>' {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:29:12.803061 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.requestlog [None req-8fec474b-bcfe-45eb-ac22-6c3061b7f3fd admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002114 Sep 25 04:29:12.804932 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: [pid: 105643|app: 0|req: 16/30] 10.222.0.25 () {54 vars in 931 bytes} [Sun Sep 25 04:29:12 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:29:13.250618 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-f689a0c3-c9a8-4f4f-a0e8-383d03cf75d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.large", "disk": 80, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "vcpus": 4, "swap": 0}} {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:29:13.259238 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG dbcounter [-] [105644] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:13.273182 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-f689a0c3-c9a8-4f4f-a0e8-383d03cf75d8 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.462886 Sep 25 04:29:13.274153 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 15/31] 10.222.0.25 () {64 vars in 1283 bytes} [Sun Sep 25 04:29:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 04:29:13.286141 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-7407e9ae-c48d-42b5-a7bd-0cc08fcc6b0e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:29:13.312511 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.requestlog [None req-7407e9ae-c48d-42b5-a7bd-0cc08fcc6b0e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030102 Sep 25 04:29:13.313428 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: [pid: 105643|app: 0|req: 17/32] 10.222.0.25 () {64 vars in 1333 bytes} [Sun Sep 25 04:29:13 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:29:15.948774 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-f689a0c3-c9a8-4f4f-a0e8-383d03cf75d8 admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:29:15.949805 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-f689a0c3-c9a8-4f4f-a0e8-383d03cf75d8 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Sep 25 04:29:15.950210 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 16/33] 10.222.0.25 () {54 vars in 931 bytes} [Sun Sep 25 04:29:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:29:16.386439 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-e8467656-5506-469c-bf53-829fdbbd4c10 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 8, "disk": 160, "id": "5", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:29:16.393135 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG dbcounter [-] [105643] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:16.411608 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.requestlog [None req-e8467656-5506-469c-bf53-829fdbbd4c10 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.454895 Sep 25 04:29:16.412269 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: [pid: 105643|app: 0|req: 18/34] 10.222.0.25 () {64 vars in 1283 bytes} [Sun Sep 25 04:29:15 2022] POST /compute/v2.1/flavors => generated 408 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 25 04:29:16.426356 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-9c595324-ec83-4dcd-84f1-563d8ec5f7be admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:29:16.454200 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-9c595324-ec83-4dcd-84f1-563d8ec5f7be admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032892 Sep 25 04:29:16.454816 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 17/35] 10.222.0.25 () {64 vars in 1333 bytes} [Sun Sep 25 04:29:16 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:29:33.172557 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-e8467656-5506-469c-bf53-829fdbbd4c10 admin admin] Calling method '>' {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:29:33.173651 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.requestlog [None req-e8467656-5506-469c-bf53-829fdbbd4c10 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Sep 25 04:29:33.174060 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: [pid: 105643|app: 0|req: 19/36] 10.222.0.25 () {54 vars in 931 bytes} [Sun Sep 25 04:29:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:29:33.185324 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG dbcounter [-] [105644] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:29:33.563517 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-f7489975-b0d8-4b5f-bbfe-c2a4bcbf52f9 admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:29:33.584217 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-f7489975-b0d8-4b5f-bbfe-c2a4bcbf52f9 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.403334 Sep 25 04:29:33.584794 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 18/37] 10.222.0.25 () {60 vars in 1292 bytes} [Sun Sep 25 04:29:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:29:35.038590 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-e8467656-5506-469c-bf53-829fdbbd4c10 admin admin] Calling method '>' {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:29:35.039615 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.requestlog [None req-e8467656-5506-469c-bf53-829fdbbd4c10 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002210 Sep 25 04:29:35.040025 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: [pid: 105643|app: 0|req: 20/38] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Sep 25 04:29:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:29:35.570299 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-72141c80-3893-4f2e-8004-9f8a51fbee38 admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:29:35.575807 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.wsgi [None req-72141c80-3893-4f2e-8004-9f8a51fbee38 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 25 04:29:35.579085 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-72141c80-3893-4f2e-8004-9f8a51fbee38 admin admin] Request method failure captured: Sep 25 04:29:35.579085 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 25 04:29:35.579085 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: Accept: application/json Sep 25 04:29:35.579085 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: Accept-Encoding: gzip, deflate Sep 25 04:29:35.579085 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: Connection: keep-alive Sep 25 04:29:35.579085 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: Content-Length: 0 Sep 25 04:29:35.579085 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: Host: 10.222.0.25 Sep 25 04:29:35.579085 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: Openstack-Api-Version: compute 2.92 Sep 25 04:29:35.579085 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: Openstack-System-Scope: None Sep 25 04:29:35.579085 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: User-Agent: python-novaclient Sep 25 04:29:35.579085 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Auth-Token: gAAAAABjL9ku7DUcv1yaiDu17nce132FwPfteXXMjqG0-JVqy8V5HPrtXSsVkGmQImFGIfIeTHe0VJEdVOR3hyRdcQUTCaNZgNvV1kOODwTTNr0-T1o6ZAfKeoF8peIYYiW9wMaQoLaI1TgJBVEzK3RiZBbfcosZevowCdkUOF-p6dOP7epYMOs Sep 25 04:29:35.579085 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Domain-Id: None Sep 25 04:29:35.579085 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Domain-Name: None Sep 25 04:29:35.579085 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Identity-Status: Confirmed Sep 25 04:29:35.579085 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Is-Admin-Project: True Sep 25 04:29:35.579085 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Openstack-Nova-Api-Version: 2.92 Sep 25 04:29:35.579085 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Project-Domain-Id: default Sep 25 04:29:35.579085 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Project-Domain-Name: Default Sep 25 04:29:35.579085 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Project-Id: 99bb568eb0e94976a15231a76508d22f Sep 25 04:29:35.579085 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Project-Name: admin Sep 25 04:29:35.579085 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Role: admin,reader,member Sep 25 04:29:35.579085 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Roles: admin,reader,member Sep 25 04:29:35.580970 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/99bb568eb0e94976a15231a76508d22f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/99bb568eb0e94976a15231a76508d22f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/99bb568eb0e94976a15231a76508d22f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_99bb568eb0e94976a15231a76508d22f"}]}] Sep 25 04:29:35.580970 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Tenant: admin Sep 25 04:29:35.580970 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Tenant-Id: 99bb568eb0e94976a15231a76508d22f Sep 25 04:29:35.580970 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Tenant-Name: admin Sep 25 04:29:35.580970 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-User: admin Sep 25 04:29:35.580970 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-User-Domain-Id: default Sep 25 04:29:35.580970 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-User-Domain-Name: Default Sep 25 04:29:35.580970 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-User-Id: e61aa4e8d68f455e96668bc70e0a6679 Sep 25 04:29:35.580970 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-User-Name: admin Sep 25 04:29:35.580970 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: method: > Sep 25 04:29:35.580970 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: exception: Flavor 42 could not be found. Sep 25 04:29:35.580970 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: action_args: {'id': '42'} Sep 25 04:29:35.580970 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:29:35.580970 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:29:35.582133 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 25 04:29:35.582133 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 25 04:29:35.582133 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 25 04:29:35.582133 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 25 04:29:35.582133 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 04:29:35.582133 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 04:29:35.582133 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 25 04:29:35.582133 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 25 04:29:35.582133 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 25 04:29:35.582133 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:29:35.582133 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 25 04:29:35.582133 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 25 04:29:35.582133 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 25 04:29:35.582133 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Sep 25 04:29:35.582133 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:29:35.582133 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Sep 25 04:29:35.582133 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:29:35.582133 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:29:35.582133 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:29:35.583689 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:29:35.583689 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:29:35.583689 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:29:35.583689 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:29:35.583689 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 25 04:29:35.583689 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:29:35.583689 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 25 04:29:35.583689 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Sep 25 04:29:35.583689 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:29:35.583689 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Sep 25 04:29:35.583689 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:29:35.583689 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:29:35.583689 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:29:35.583689 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:29:35.583689 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:29:35.583689 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 25 04:29:35.583689 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Sep 25 04:29:35.583689 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-72141c80-3893-4f2e-8004-9f8a51fbee38 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:29:35.585017 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-72141c80-3893-4f2e-8004-9f8a51fbee38 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.398360 Sep 25 04:29:35.585017 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 19/39] 10.222.0.25 () {60 vars in 1190 bytes} [Sun Sep 25 04:29:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 25 04:29:35.591121 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-e86f709a-4fc6-4773-9f09-7e0cc7b25f10 admin admin] Calling method '>' {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:29:35.619725 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.requestlog [None req-e86f709a-4fc6-4773-9f09-7e0cc7b25f10 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.032558 Sep 25 04:29:35.620271 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: [pid: 105643|app: 0|req: 21/40] 10.222.0.25 () {60 vars in 1210 bytes} [Sun Sep 25 04:29:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:29:35.631562 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-501b8886-1a6f-429e-9729-5012e358cfa6 admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:29:35.660387 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-501b8886-1a6f-429e-9729-5012e358cfa6 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.034023 Sep 25 04:29:35.660993 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 20/41] 10.222.0.25 () {60 vars in 1210 bytes} [Sun Sep 25 04:29:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:29:35.670868 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-0d04cb58-bf3b-4e40-b3f0-c3578f0b9042 admin admin] Calling method '>' {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:29:35.676359 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.wsgi [None req-0d04cb58-bf3b-4e40-b3f0-c3578f0b9042 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 25 04:29:35.680377 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-0d04cb58-bf3b-4e40-b3f0-c3578f0b9042 admin admin] Request method failure captured: Sep 25 04:29:35.680377 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 25 04:29:35.680377 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: Accept: application/json Sep 25 04:29:35.680377 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: Accept-Encoding: gzip, deflate Sep 25 04:29:35.680377 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: Connection: keep-alive Sep 25 04:29:35.680377 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: Content-Length: 0 Sep 25 04:29:35.680377 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: Host: 10.222.0.25 Sep 25 04:29:35.680377 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: Openstack-Api-Version: compute 2.92 Sep 25 04:29:35.680377 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: Openstack-System-Scope: None Sep 25 04:29:35.680377 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: User-Agent: python-novaclient Sep 25 04:29:35.680377 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Auth-Token: gAAAAABjL9ku7DUcv1yaiDu17nce132FwPfteXXMjqG0-JVqy8V5HPrtXSsVkGmQImFGIfIeTHe0VJEdVOR3hyRdcQUTCaNZgNvV1kOODwTTNr0-T1o6ZAfKeoF8peIYYiW9wMaQoLaI1TgJBVEzK3RiZBbfcosZevowCdkUOF-p6dOP7epYMOs Sep 25 04:29:35.680377 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Domain-Id: None Sep 25 04:29:35.680377 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Domain-Name: None Sep 25 04:29:35.680377 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Identity-Status: Confirmed Sep 25 04:29:35.680377 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Is-Admin-Project: True Sep 25 04:29:35.680377 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Openstack-Nova-Api-Version: 2.92 Sep 25 04:29:35.680377 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Project-Domain-Id: default Sep 25 04:29:35.680377 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Project-Domain-Name: Default Sep 25 04:29:35.680377 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Project-Id: 99bb568eb0e94976a15231a76508d22f Sep 25 04:29:35.680377 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Project-Name: admin Sep 25 04:29:35.680377 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Role: admin,reader,member Sep 25 04:29:35.680377 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Roles: admin,reader,member Sep 25 04:29:35.681987 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/99bb568eb0e94976a15231a76508d22f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/99bb568eb0e94976a15231a76508d22f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/99bb568eb0e94976a15231a76508d22f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_99bb568eb0e94976a15231a76508d22f"}]}] Sep 25 04:29:35.681987 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Tenant: admin Sep 25 04:29:35.681987 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Tenant-Id: 99bb568eb0e94976a15231a76508d22f Sep 25 04:29:35.681987 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Tenant-Name: admin Sep 25 04:29:35.681987 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-User: admin Sep 25 04:29:35.681987 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-User-Domain-Id: default Sep 25 04:29:35.681987 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-User-Domain-Name: Default Sep 25 04:29:35.681987 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-User-Id: e61aa4e8d68f455e96668bc70e0a6679 Sep 25 04:29:35.681987 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-User-Name: admin Sep 25 04:29:35.681987 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: method: > Sep 25 04:29:35.681987 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: exception: Flavor 42 could not be found. Sep 25 04:29:35.681987 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: action_args: {'id': '42'} Sep 25 04:29:35.681987 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:29:35.681987 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:29:35.683136 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 25 04:29:35.683136 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 25 04:29:35.683136 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 25 04:29:35.683136 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 25 04:29:35.683136 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 04:29:35.683136 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 04:29:35.683136 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 25 04:29:35.683136 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 25 04:29:35.683136 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 25 04:29:35.683136 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:29:35.683136 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 25 04:29:35.683136 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 25 04:29:35.683136 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 25 04:29:35.683136 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi Sep 25 04:29:35.683136 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:29:35.683136 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi Sep 25 04:29:35.683136 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:29:35.683136 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:29:35.683136 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:29:35.684490 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:29:35.684490 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:29:35.684490 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:29:35.684490 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:29:35.684490 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 25 04:29:35.684490 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:29:35.684490 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 25 04:29:35.684490 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi Sep 25 04:29:35.684490 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:29:35.684490 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi Sep 25 04:29:35.684490 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:29:35.684490 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:29:35.684490 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:29:35.684490 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:29:35.684490 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:29:35.684490 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 25 04:29:35.684490 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi Sep 25 04:29:35.684490 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-0d04cb58-bf3b-4e40-b3f0-c3578f0b9042 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:29:35.685892 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.requestlog [None req-0d04cb58-bf3b-4e40-b3f0-c3578f0b9042 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014611 Sep 25 04:29:35.685892 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: [pid: 105643|app: 0|req: 22/42] 10.222.0.25 () {60 vars in 1190 bytes} [Sun Sep 25 04:29:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 25 04:29:36.908807 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-501b8886-1a6f-429e-9729-5012e358cfa6 admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:29:36.909829 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-501b8886-1a6f-429e-9729-5012e358cfa6 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Sep 25 04:29:36.910230 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 21/43] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Sep 25 04:29:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:29:37.437482 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-b69fb2e8-32f0-4205-bd31-bec57c09064b admin admin] Calling method '>' {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:29:37.442653 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.wsgi [None req-b69fb2e8-32f0-4205-bd31-bec57c09064b admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 25 04:29:37.444246 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-b69fb2e8-32f0-4205-bd31-bec57c09064b admin admin] Request method failure captured: Sep 25 04:29:37.444246 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 25 04:29:37.444246 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: Accept: application/json Sep 25 04:29:37.444246 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: Accept-Encoding: gzip, deflate Sep 25 04:29:37.444246 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: Connection: keep-alive Sep 25 04:29:37.444246 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: Content-Length: 0 Sep 25 04:29:37.444246 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: Host: 10.222.0.25 Sep 25 04:29:37.444246 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: Openstack-Api-Version: compute 2.92 Sep 25 04:29:37.444246 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: Openstack-System-Scope: None Sep 25 04:29:37.444246 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: User-Agent: python-novaclient Sep 25 04:29:37.444246 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Auth-Token: gAAAAABjL9kwvG1g9siPp4MvA2CrfT08FTuynbVviITenm12F-kKCO49Nf0tlJtRvDzLU_7PyefvS_3RKRzkVS3xxEJxaPQ3IMEvFLxFkzSbk1XjZupphmSsR2EWsP9Lh1G3su6G07ZWLSXmPtZHp-bxFNg0LpWMFNOIBLJO_zWSrHtjcUG6hBA Sep 25 04:29:37.444246 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Domain-Id: None Sep 25 04:29:37.444246 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Domain-Name: None Sep 25 04:29:37.444246 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Identity-Status: Confirmed Sep 25 04:29:37.444246 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Is-Admin-Project: True Sep 25 04:29:37.444246 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Openstack-Nova-Api-Version: 2.92 Sep 25 04:29:37.444246 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Project-Domain-Id: default Sep 25 04:29:37.444246 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Project-Domain-Name: Default Sep 25 04:29:37.444246 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Project-Id: 99bb568eb0e94976a15231a76508d22f Sep 25 04:29:37.444246 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Project-Name: admin Sep 25 04:29:37.444246 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Role: admin,reader,member Sep 25 04:29:37.444246 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Roles: admin,reader,member Sep 25 04:29:37.445798 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/99bb568eb0e94976a15231a76508d22f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/99bb568eb0e94976a15231a76508d22f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/99bb568eb0e94976a15231a76508d22f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_99bb568eb0e94976a15231a76508d22f"}]}] Sep 25 04:29:37.445798 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Tenant: admin Sep 25 04:29:37.445798 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Tenant-Id: 99bb568eb0e94976a15231a76508d22f Sep 25 04:29:37.445798 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Tenant-Name: admin Sep 25 04:29:37.445798 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-User: admin Sep 25 04:29:37.445798 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-User-Domain-Id: default Sep 25 04:29:37.445798 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-User-Domain-Name: Default Sep 25 04:29:37.445798 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-User-Id: e61aa4e8d68f455e96668bc70e0a6679 Sep 25 04:29:37.445798 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-User-Name: admin Sep 25 04:29:37.445798 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: method: > Sep 25 04:29:37.445798 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: exception: Flavor 84 could not be found. Sep 25 04:29:37.445798 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: action_args: {'id': '84'} Sep 25 04:29:37.445798 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:29:37.445798 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:29:37.446612 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 25 04:29:37.446612 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 25 04:29:37.446612 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 25 04:29:37.446612 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 25 04:29:37.446612 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 04:29:37.446612 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 04:29:37.446612 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 25 04:29:37.446612 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 25 04:29:37.446612 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 25 04:29:37.446612 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:29:37.446612 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 25 04:29:37.446612 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 25 04:29:37.446612 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 25 04:29:37.446612 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi Sep 25 04:29:37.446612 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:29:37.446612 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi Sep 25 04:29:37.446612 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:29:37.446612 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:29:37.446612 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:29:37.448022 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:29:37.448022 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:29:37.448022 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:29:37.448022 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:29:37.448022 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 25 04:29:37.448022 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:29:37.448022 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 25 04:29:37.448022 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi Sep 25 04:29:37.448022 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:29:37.448022 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi Sep 25 04:29:37.448022 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:29:37.448022 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:29:37.448022 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:29:37.448022 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:29:37.448022 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:29:37.448022 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 25 04:29:37.448022 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi Sep 25 04:29:37.448022 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-b69fb2e8-32f0-4205-bd31-bec57c09064b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:29:37.449319 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.requestlog [None req-b69fb2e8-32f0-4205-bd31-bec57c09064b admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.388022 Sep 25 04:29:37.449319 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: [pid: 105643|app: 0|req: 23/44] 10.222.0.25 () {60 vars in 1190 bytes} [Sun Sep 25 04:29:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 25 04:29:37.455837 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-25cca7ea-ab50-4279-9162-fa5b62bf5d3a admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:29:37.472264 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-25cca7ea-ab50-4279-9162-fa5b62bf5d3a admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020369 Sep 25 04:29:37.473246 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 22/45] 10.222.0.25 () {60 vars in 1210 bytes} [Sun Sep 25 04:29:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:29:37.483664 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-dd989c75-9ca4-43be-b160-85aa9812a6d0 admin admin] Calling method '>' {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:29:37.501118 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.requestlog [None req-dd989c75-9ca4-43be-b160-85aa9812a6d0 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021216 Sep 25 04:29:37.501654 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: [pid: 105643|app: 0|req: 24/46] 10.222.0.25 () {60 vars in 1210 bytes} [Sun Sep 25 04:29:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:29:37.511332 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-61e350f8-c837-4de9-b2d4-922c08c85277 admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:29:37.516526 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.wsgi [None req-61e350f8-c837-4de9-b2d4-922c08c85277 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 25 04:29:37.518116 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-61e350f8-c837-4de9-b2d4-922c08c85277 admin admin] Request method failure captured: Sep 25 04:29:37.518116 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 25 04:29:37.518116 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: Accept: application/json Sep 25 04:29:37.518116 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: Accept-Encoding: gzip, deflate Sep 25 04:29:37.518116 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: Connection: keep-alive Sep 25 04:29:37.518116 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: Content-Length: 0 Sep 25 04:29:37.518116 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: Host: 10.222.0.25 Sep 25 04:29:37.518116 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: Openstack-Api-Version: compute 2.92 Sep 25 04:29:37.518116 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: Openstack-System-Scope: None Sep 25 04:29:37.518116 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: User-Agent: python-novaclient Sep 25 04:29:37.518116 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Auth-Token: gAAAAABjL9kwvG1g9siPp4MvA2CrfT08FTuynbVviITenm12F-kKCO49Nf0tlJtRvDzLU_7PyefvS_3RKRzkVS3xxEJxaPQ3IMEvFLxFkzSbk1XjZupphmSsR2EWsP9Lh1G3su6G07ZWLSXmPtZHp-bxFNg0LpWMFNOIBLJO_zWSrHtjcUG6hBA Sep 25 04:29:37.518116 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Domain-Id: None Sep 25 04:29:37.518116 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Domain-Name: None Sep 25 04:29:37.518116 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Identity-Status: Confirmed Sep 25 04:29:37.518116 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Is-Admin-Project: True Sep 25 04:29:37.518116 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Openstack-Nova-Api-Version: 2.92 Sep 25 04:29:37.518116 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Project-Domain-Id: default Sep 25 04:29:37.518116 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Project-Domain-Name: Default Sep 25 04:29:37.518116 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Project-Id: 99bb568eb0e94976a15231a76508d22f Sep 25 04:29:37.518116 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Project-Name: admin Sep 25 04:29:37.518116 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Role: admin,reader,member Sep 25 04:29:37.518116 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Roles: admin,reader,member Sep 25 04:29:37.519686 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/99bb568eb0e94976a15231a76508d22f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/99bb568eb0e94976a15231a76508d22f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/99bb568eb0e94976a15231a76508d22f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_99bb568eb0e94976a15231a76508d22f"}]}] Sep 25 04:29:37.519686 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Tenant: admin Sep 25 04:29:37.519686 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Tenant-Id: 99bb568eb0e94976a15231a76508d22f Sep 25 04:29:37.519686 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Tenant-Name: admin Sep 25 04:29:37.519686 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-User: admin Sep 25 04:29:37.519686 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-User-Domain-Id: default Sep 25 04:29:37.519686 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-User-Domain-Name: Default Sep 25 04:29:37.519686 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-User-Id: e61aa4e8d68f455e96668bc70e0a6679 Sep 25 04:29:37.519686 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-User-Name: admin Sep 25 04:29:37.519686 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: method: > Sep 25 04:29:37.519686 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: exception: Flavor 84 could not be found. Sep 25 04:29:37.519686 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: action_args: {'id': '84'} Sep 25 04:29:37.519686 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:29:37.519686 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:29:37.520984 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 25 04:29:37.520984 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 25 04:29:37.520984 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 25 04:29:37.520984 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 25 04:29:37.520984 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 04:29:37.520984 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 04:29:37.520984 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 25 04:29:37.520984 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 25 04:29:37.520984 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 25 04:29:37.520984 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:29:37.520984 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 25 04:29:37.520984 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 25 04:29:37.520984 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 25 04:29:37.520984 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Sep 25 04:29:37.520984 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:29:37.520984 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Sep 25 04:29:37.520984 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:29:37.520984 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:29:37.520984 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:29:37.523340 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:29:37.523340 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:29:37.523340 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:29:37.523340 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:29:37.523340 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 25 04:29:37.523340 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:29:37.523340 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 25 04:29:37.523340 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Sep 25 04:29:37.523340 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:29:37.523340 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Sep 25 04:29:37.523340 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:29:37.523340 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:29:37.523340 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:29:37.523340 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:29:37.523340 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:29:37.523340 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 25 04:29:37.523340 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Sep 25 04:29:37.523340 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-61e350f8-c837-4de9-b2d4-922c08c85277 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:29:37.524617 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-61e350f8-c837-4de9-b2d4-922c08c85277 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011859 Sep 25 04:29:37.524617 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 23/47] 10.222.0.25 () {60 vars in 1190 bytes} [Sun Sep 25 04:29:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 25 04:29:38.747544 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-dd989c75-9ca4-43be-b160-85aa9812a6d0 admin admin] Calling method '>' {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:29:38.748567 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.requestlog [None req-dd989c75-9ca4-43be-b160-85aa9812a6d0 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Sep 25 04:29:38.749005 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: [pid: 105643|app: 0|req: 25/48] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Sep 25 04:29:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:29:39.285616 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-8b6ee3b4-4e23-4389-90c5-c950598c67fb admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:29:39.292625 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.wsgi [None req-8b6ee3b4-4e23-4389-90c5-c950598c67fb admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 25 04:29:39.294189 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-8b6ee3b4-4e23-4389-90c5-c950598c67fb admin admin] Request method failure captured: Sep 25 04:29:39.294189 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 25 04:29:39.294189 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: Accept: application/json Sep 25 04:29:39.294189 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: Accept-Encoding: gzip, deflate Sep 25 04:29:39.294189 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: Connection: keep-alive Sep 25 04:29:39.294189 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: Content-Length: 0 Sep 25 04:29:39.294189 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: Host: 10.222.0.25 Sep 25 04:29:39.294189 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: Openstack-Api-Version: compute 2.92 Sep 25 04:29:39.294189 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: Openstack-System-Scope: None Sep 25 04:29:39.294189 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: User-Agent: python-novaclient Sep 25 04:29:39.294189 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Auth-Token: gAAAAABjL9ky4z--1Y4qLVffW6JBQSBF0I4reAXoIxoJRKLfyZ9-JOk-HCW5bMhl8_dtj7g5K_P_WfCJVIlWq6pN_YTm59047BvIVQ0ZLoodVViWBZwpvgia7zLFPZ_aiHo5IAGtyyfxMi9uyt1ai5QuQzW5rz8BvuiLaxCbA5aOcAft9KzMES8 Sep 25 04:29:39.294189 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Domain-Id: None Sep 25 04:29:39.294189 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Domain-Name: None Sep 25 04:29:39.294189 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Identity-Status: Confirmed Sep 25 04:29:39.294189 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Is-Admin-Project: True Sep 25 04:29:39.294189 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Openstack-Nova-Api-Version: 2.92 Sep 25 04:29:39.294189 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Project-Domain-Id: default Sep 25 04:29:39.294189 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Project-Domain-Name: Default Sep 25 04:29:39.294189 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Project-Id: 99bb568eb0e94976a15231a76508d22f Sep 25 04:29:39.294189 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Project-Name: admin Sep 25 04:29:39.294189 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Role: admin,reader,member Sep 25 04:29:39.294189 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Roles: admin,reader,member Sep 25 04:29:39.295889 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/99bb568eb0e94976a15231a76508d22f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/99bb568eb0e94976a15231a76508d22f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/99bb568eb0e94976a15231a76508d22f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_99bb568eb0e94976a15231a76508d22f"}]}] Sep 25 04:29:39.295889 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Tenant: admin Sep 25 04:29:39.295889 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Tenant-Id: 99bb568eb0e94976a15231a76508d22f Sep 25 04:29:39.295889 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-Tenant-Name: admin Sep 25 04:29:39.295889 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-User: admin Sep 25 04:29:39.295889 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-User-Domain-Id: default Sep 25 04:29:39.295889 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-User-Domain-Name: Default Sep 25 04:29:39.295889 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-User-Id: e61aa4e8d68f455e96668bc70e0a6679 Sep 25 04:29:39.295889 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: X-User-Name: admin Sep 25 04:29:39.295889 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: method: > Sep 25 04:29:39.295889 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: exception: Flavor 451 could not be found. Sep 25 04:29:39.295889 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: action_args: {'id': '451'} Sep 25 04:29:39.295889 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:29:39.295889 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:29:39.296850 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 25 04:29:39.296850 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 25 04:29:39.296850 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 25 04:29:39.296850 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 25 04:29:39.296850 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 04:29:39.296850 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 04:29:39.296850 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 25 04:29:39.296850 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 25 04:29:39.296850 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 25 04:29:39.296850 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:29:39.296850 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 25 04:29:39.296850 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 25 04:29:39.296850 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 25 04:29:39.296850 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Sep 25 04:29:39.296850 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:29:39.296850 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Sep 25 04:29:39.296850 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:29:39.296850 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:29:39.296850 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:29:39.298031 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:29:39.298031 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:29:39.298031 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:29:39.298031 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:29:39.298031 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 25 04:29:39.298031 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:29:39.298031 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 25 04:29:39.298031 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Sep 25 04:29:39.298031 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:29:39.298031 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Sep 25 04:29:39.298031 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:29:39.298031 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:29:39.298031 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:29:39.298031 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:29:39.298031 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:29:39.298031 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 25 04:29:39.298031 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Sep 25 04:29:39.298031 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-8b6ee3b4-4e23-4389-90c5-c950598c67fb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:29:39.299062 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-8b6ee3b4-4e23-4389-90c5-c950598c67fb admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.401917 Sep 25 04:29:39.299062 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 24/49] 10.222.0.25 () {60 vars in 1193 bytes} [Sun Sep 25 04:29:38 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 25 04:29:39.305683 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-144927fd-77f5-44ea-a427-c66815041e45 admin admin] Calling method '>' {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:29:39.321938 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.requestlog [None req-144927fd-77f5-44ea-a427-c66815041e45 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020070 Sep 25 04:29:39.322461 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: [pid: 105643|app: 0|req: 26/50] 10.222.0.25 () {60 vars in 1210 bytes} [Sun Sep 25 04:29:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:29:39.331977 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-c099b25b-2a31-4896-adfc-adba16a90f57 admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:29:39.349099 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-c099b25b-2a31-4896-adfc-adba16a90f57 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020939 Sep 25 04:29:39.350485 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 25/51] 10.222.0.25 () {60 vars in 1210 bytes} [Sun Sep 25 04:29:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:29:39.359713 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-2c00ad0e-318d-464d-9ef1-ca5a38d79a71 admin admin] Calling method '>' {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:29:39.365061 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.wsgi [None req-2c00ad0e-318d-464d-9ef1-ca5a38d79a71 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 25 04:29:39.366601 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-2c00ad0e-318d-464d-9ef1-ca5a38d79a71 admin admin] Request method failure captured: Sep 25 04:29:39.366601 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 25 04:29:39.366601 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: Accept: application/json Sep 25 04:29:39.366601 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: Accept-Encoding: gzip, deflate Sep 25 04:29:39.366601 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: Connection: keep-alive Sep 25 04:29:39.366601 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: Content-Length: 0 Sep 25 04:29:39.366601 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: Host: 10.222.0.25 Sep 25 04:29:39.366601 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: Openstack-Api-Version: compute 2.92 Sep 25 04:29:39.366601 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: Openstack-System-Scope: None Sep 25 04:29:39.366601 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: User-Agent: python-novaclient Sep 25 04:29:39.366601 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Auth-Token: gAAAAABjL9ky4z--1Y4qLVffW6JBQSBF0I4reAXoIxoJRKLfyZ9-JOk-HCW5bMhl8_dtj7g5K_P_WfCJVIlWq6pN_YTm59047BvIVQ0ZLoodVViWBZwpvgia7zLFPZ_aiHo5IAGtyyfxMi9uyt1ai5QuQzW5rz8BvuiLaxCbA5aOcAft9KzMES8 Sep 25 04:29:39.366601 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Domain-Id: None Sep 25 04:29:39.366601 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Domain-Name: None Sep 25 04:29:39.366601 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Identity-Status: Confirmed Sep 25 04:29:39.366601 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Is-Admin-Project: True Sep 25 04:29:39.366601 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Openstack-Nova-Api-Version: 2.92 Sep 25 04:29:39.366601 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Project-Domain-Id: default Sep 25 04:29:39.366601 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Project-Domain-Name: Default Sep 25 04:29:39.366601 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Project-Id: 99bb568eb0e94976a15231a76508d22f Sep 25 04:29:39.366601 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Project-Name: admin Sep 25 04:29:39.366601 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Role: admin,reader,member Sep 25 04:29:39.366601 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Roles: admin,reader,member Sep 25 04:29:39.368212 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/99bb568eb0e94976a15231a76508d22f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/99bb568eb0e94976a15231a76508d22f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/99bb568eb0e94976a15231a76508d22f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_99bb568eb0e94976a15231a76508d22f"}]}] Sep 25 04:29:39.368212 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Tenant: admin Sep 25 04:29:39.368212 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Tenant-Id: 99bb568eb0e94976a15231a76508d22f Sep 25 04:29:39.368212 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-Tenant-Name: admin Sep 25 04:29:39.368212 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-User: admin Sep 25 04:29:39.368212 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-User-Domain-Id: default Sep 25 04:29:39.368212 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-User-Domain-Name: Default Sep 25 04:29:39.368212 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-User-Id: e61aa4e8d68f455e96668bc70e0a6679 Sep 25 04:29:39.368212 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: X-User-Name: admin Sep 25 04:29:39.368212 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: method: > Sep 25 04:29:39.368212 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: exception: Flavor 451 could not be found. Sep 25 04:29:39.368212 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: action_args: {'id': '451'} Sep 25 04:29:39.368212 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:29:39.368212 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:29:39.369592 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 25 04:29:39.369592 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 25 04:29:39.369592 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 25 04:29:39.369592 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 25 04:29:39.369592 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 04:29:39.369592 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 04:29:39.369592 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 25 04:29:39.369592 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 25 04:29:39.369592 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 25 04:29:39.369592 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:29:39.369592 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 25 04:29:39.369592 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 25 04:29:39.369592 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 25 04:29:39.369592 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi Sep 25 04:29:39.369592 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:29:39.369592 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi Sep 25 04:29:39.369592 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:29:39.369592 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:29:39.369592 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:29:39.370907 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:29:39.370907 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:29:39.370907 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:29:39.370907 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:29:39.370907 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 25 04:29:39.370907 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:29:39.370907 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 25 04:29:39.370907 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi Sep 25 04:29:39.370907 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:29:39.370907 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi Sep 25 04:29:39.370907 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:29:39.370907 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:29:39.370907 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:29:39.370907 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:29:39.370907 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:29:39.370907 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 25 04:29:39.370907 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: ERROR nova.api.openstack.wsgi Sep 25 04:29:39.370907 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-2c00ad0e-318d-464d-9ef1-ca5a38d79a71 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:29:39.372199 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.requestlog [None req-2c00ad0e-318d-464d-9ef1-ca5a38d79a71 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011890 Sep 25 04:29:39.372199 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: [pid: 105643|app: 0|req: 27/52] 10.222.0.25 () {60 vars in 1193 bytes} [Sun Sep 25 04:29:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 25 04:29:40.599877 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-c099b25b-2a31-4896-adfc-adba16a90f57 admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:29:40.600954 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-c099b25b-2a31-4896-adfc-adba16a90f57 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002046 Sep 25 04:29:40.601353 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 26/53] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Sep 25 04:29:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:29:41.137715 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-1f379cba-2bf9-4a62-af30-55754f5ec3f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:29:41.157927 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.requestlog [None req-1f379cba-2bf9-4a62-af30-55754f5ec3f2 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.415497 Sep 25 04:29:41.158505 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: [pid: 105643|app: 0|req: 28/54] 10.222.0.25 () {64 vars in 1235 bytes} [Sun Sep 25 04:29:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 04:29:42.373176 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-c099b25b-2a31-4896-adfc-adba16a90f57 admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:29:42.374197 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-c099b25b-2a31-4896-adfc-adba16a90f57 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Sep 25 04:29:42.374605 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 27/55] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Sep 25 04:29:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:29:42.900092 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-514c8094-0be8-4ab7-ba73-75c089ea2fcb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:29:42.919637 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.requestlog [None req-514c8094-0be8-4ab7-ba73-75c089ea2fcb admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.407246 Sep 25 04:29:42.920189 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: [pid: 105643|app: 0|req: 29/56] 10.222.0.25 () {64 vars in 1235 bytes} [Sun Sep 25 04:29:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 04:29:44.259863 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-c099b25b-2a31-4896-adfc-adba16a90f57 admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:29:44.260924 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-c099b25b-2a31-4896-adfc-adba16a90f57 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Sep 25 04:29:44.261333 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 28/57] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Sep 25 04:29:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:29:44.785206 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-7f0c5fc2-c80d-4e08-9f6b-776c3b5502c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:29:44.804911 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.requestlog [None req-7f0c5fc2-c80d-4e08-9f6b-776c3b5502c0 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.405504 Sep 25 04:29:44.805457 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: [pid: 105643|app: 0|req: 30/58] 10.222.0.25 () {64 vars in 1235 bytes} [Sun Sep 25 04:29:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 04:29:46.030785 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-c099b25b-2a31-4896-adfc-adba16a90f57 admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:29:46.031798 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-c099b25b-2a31-4896-adfc-adba16a90f57 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Sep 25 04:29:46.032197 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 29/59] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Sep 25 04:29:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:29:46.548204 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-31051ad5-93db-4257-a4d8-db0c720025ce admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:29:46.566887 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.requestlog [None req-31051ad5-93db-4257-a4d8-db0c720025ce admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.396364 Sep 25 04:29:46.567435 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: [pid: 105643|app: 0|req: 31/60] 10.222.0.25 () {64 vars in 1235 bytes} [Sun Sep 25 04:29:46 2022] POST /compute/v2.1/flavors => generated 409 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 04:29:47.781758 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-c099b25b-2a31-4896-adfc-adba16a90f57 admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:29:47.782910 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-c099b25b-2a31-4896-adfc-adba16a90f57 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001558 Sep 25 04:29:47.783316 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 30/61] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Sep 25 04:29:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:29:48.307441 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-94eef4d3-aee6-4a08-972e-f630e0600cb1 admin admin] Calling method '>' {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:29:48.330622 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.requestlog [None req-94eef4d3-aee6-4a08-972e-f630e0600cb1 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.407192 Sep 25 04:29:48.331113 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: [pid: 105643|app: 0|req: 32/62] 10.222.0.25 () {60 vars in 1202 bytes} [Sun Sep 25 04:29:47 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:30:45.244338 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-c099b25b-2a31-4896-adfc-adba16a90f57 admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:30:45.245414 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-c099b25b-2a31-4896-adfc-adba16a90f57 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Sep 25 04:30:45.245822 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 31/63] 10.222.0.25 () {54 vars in 931 bytes} [Sun Sep 25 04:30:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:30:45.256528 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG dbcounter [-] [105643] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:30:45.636815 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-28230727-7b86-4995-a432-ad44cfb935a7 admin admin] Calling method '>' {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:30:45.662829 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.requestlog [None req-28230727-7b86-4995-a432-ad44cfb935a7 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.410740 Sep 25 04:30:45.663409 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: [pid: 105643|app: 0|req: 33/64] 10.222.0.25 () {60 vars in 1292 bytes} [Sun Sep 25 04:30:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:30:45.685093 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG dbcounter [-] [105644] Writing DB stats nova_api:SELECT=14 {{(pid=105644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:30:45.688946 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-0b446a18-eee7-4a1b-82cc-fc2e0a9c73be admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:30:45.696475 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-0b446a18-eee7-4a1b-82cc-fc2e0a9c73be admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012914 Sep 25 04:30:45.697061 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 32/65] 10.222.0.25 () {60 vars in 1283 bytes} [Sun Sep 25 04:30:45 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:30:45.709213 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-eff5847f-c8ce-4fdd-8ca4-6d155b485943 admin admin] Calling method '>' {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:30:45.717143 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.requestlog [None req-eff5847f-c8ce-4fdd-8ca4-6d155b485943 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012101 Sep 25 04:30:45.717675 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: [pid: 105643|app: 0|req: 34/66] 10.222.0.25 () {60 vars in 1286 bytes} [Sun Sep 25 04:30:45 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:30:45.729797 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-bfe9e0f1-0e40-43f2-9c84-a838528d3ee0 admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:30:45.738084 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-bfe9e0f1-0e40-43f2-9c84-a838528d3ee0 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011278 Sep 25 04:30:45.738855 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 33/67] 10.222.0.25 () {60 vars in 1286 bytes} [Sun Sep 25 04:30:45 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:30:45.750123 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-c6870510-10df-42c9-b45c-a6567068a3f5 admin admin] Calling method '>' {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:30:45.757777 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.requestlog [None req-c6870510-10df-42c9-b45c-a6567068a3f5 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011225 Sep 25 04:30:45.758292 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: [pid: 105643|app: 0|req: 35/68] 10.222.0.25 () {60 vars in 1283 bytes} [Sun Sep 25 04:30:45 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:33:43.114885 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-bfe9e0f1-0e40-43f2-9c84-a838528d3ee0 admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:33:43.115943 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-bfe9e0f1-0e40-43f2-9c84-a838528d3ee0 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Sep 25 04:33:43.116350 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 34/69] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Sep 25 04:33:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:33:43.259056 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG dbcounter [-] [105643] Writing DB stats nova_api:SELECT=6 {{(pid=105643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:33:43.418391 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-6823a550-d377-42ed-8f13-d0db6150b776 admin admin] Calling method '>' {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:33:43.423351 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG oslo_concurrency.lockutils [None req-6823a550-d377-42ed-8f13-d0db6150b776 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:33:43.423819 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG oslo_concurrency.lockutils [None req-6823a550-d377-42ed-8f13-d0db6150b776 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:33:43.424242 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG oslo_concurrency.lockutils [None req-6823a550-d377-42ed-8f13-d0db6150b776 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:33:43.424983 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG oslo_concurrency.lockutils [None req-6823a550-d377-42ed-8f13-d0db6150b776 admin admin] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:33:43.425428 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG oslo_concurrency.lockutils [None req-6823a550-d377-42ed-8f13-d0db6150b776 admin admin] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:33:43.425842 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG oslo_concurrency.lockutils [None req-6823a550-d377-42ed-8f13-d0db6150b776 admin admin] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:33:43.462880 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.requestlog [None req-6823a550-d377-42ed-8f13-d0db6150b776 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.205001 Sep 25 04:33:43.463434 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: [pid: 105643|app: 0|req: 36/70] 10.222.0.25 () {60 vars in 1193 bytes} [Sun Sep 25 04:33:43 2022] GET /compute/v2.1/os-services => generated 791 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 04:33:44.550801 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-bfe9e0f1-0e40-43f2-9c84-a838528d3ee0 admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:33:44.551812 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-bfe9e0f1-0e40-43f2-9c84-a838528d3ee0 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Sep 25 04:33:44.552210 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 35/71] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Sep 25 04:33:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:33:44.742141 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-e4703d2c-2381-40a2-a66e-b511b464c53f admin admin] Calling method '>' {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:33:44.745553 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG oslo_concurrency.lockutils [None req-e4703d2c-2381-40a2-a66e-b511b464c53f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:33:44.746032 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG oslo_concurrency.lockutils [None req-e4703d2c-2381-40a2-a66e-b511b464c53f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:33:44.746461 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG oslo_concurrency.lockutils [None req-e4703d2c-2381-40a2-a66e-b511b464c53f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:33:44.747171 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG oslo_concurrency.lockutils [None req-e4703d2c-2381-40a2-a66e-b511b464c53f admin admin] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:33:44.747616 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG oslo_concurrency.lockutils [None req-e4703d2c-2381-40a2-a66e-b511b464c53f admin admin] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:33:44.748030 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG oslo_concurrency.lockutils [None req-e4703d2c-2381-40a2-a66e-b511b464c53f admin admin] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:33:44.769397 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.requestlog [None req-e4703d2c-2381-40a2-a66e-b511b464c53f admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.079268 Sep 25 04:33:44.769950 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: [pid: 105643|app: 0|req: 37/72] 10.222.0.25 () {60 vars in 1193 bytes} [Sun Sep 25 04:33:44 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 04:33:56.283106 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-bfe9e0f1-0e40-43f2-9c84-a838528d3ee0 admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:33:56.284121 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-bfe9e0f1-0e40-43f2-9c84-a838528d3ee0 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Sep 25 04:33:56.284556 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 36/73] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Sep 25 04:33:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:33:56.427762 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG dbcounter [-] [105643] Writing DB stats nova_cell0:SELECT=4 {{(pid=105643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:33:56.428479 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG dbcounter [-] [105643] Writing DB stats nova_cell1:SELECT=4 {{(pid=105643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:33:56.429122 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG dbcounter [-] [105643] Writing DB stats nova_api:SELECT=8 {{(pid=105643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:33:56.478166 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-8e299cac-452a-46a5-9c80-8e11a6c4c627 admin admin] Calling method '>' {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:33:56.481723 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG oslo_concurrency.lockutils [None req-8e299cac-452a-46a5-9c80-8e11a6c4c627 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:33:56.482198 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG oslo_concurrency.lockutils [None req-8e299cac-452a-46a5-9c80-8e11a6c4c627 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:33:56.482629 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG oslo_concurrency.lockutils [None req-8e299cac-452a-46a5-9c80-8e11a6c4c627 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:33:56.483862 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG oslo_concurrency.lockutils [None req-8e299cac-452a-46a5-9c80-8e11a6c4c627 admin admin] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:33:56.484448 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG oslo_concurrency.lockutils [None req-8e299cac-452a-46a5-9c80-8e11a6c4c627 admin admin] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:33:56.484901 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG oslo_concurrency.lockutils [None req-8e299cac-452a-46a5-9c80-8e11a6c4c627 admin admin] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:33:56.511602 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.requestlog [None req-8e299cac-452a-46a5-9c80-8e11a6c4c627 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.088156 Sep 25 04:33:56.512071 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: [pid: 105643|app: 0|req: 38/74] 10.222.0.25 () {60 vars in 1193 bytes} [Sun Sep 25 04:33:56 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:33:57.597142 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-bfe9e0f1-0e40-43f2-9c84-a838528d3ee0 admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:33:57.598166 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-bfe9e0f1-0e40-43f2-9c84-a838528d3ee0 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Sep 25 04:33:57.598576 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 37/75] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Sep 25 04:33:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:33:57.788827 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG nova.api.openstack.wsgi [None req-39561063-7ce1-4c9e-91d6-a99b81928a95 admin admin] Calling method '>' {{(pid=105643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:33:57.792184 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG oslo_concurrency.lockutils [None req-39561063-7ce1-4c9e-91d6-a99b81928a95 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:33:57.792677 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG oslo_concurrency.lockutils [None req-39561063-7ce1-4c9e-91d6-a99b81928a95 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:33:57.793114 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG oslo_concurrency.lockutils [None req-39561063-7ce1-4c9e-91d6-a99b81928a95 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:33:57.793832 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG oslo_concurrency.lockutils [None req-39561063-7ce1-4c9e-91d6-a99b81928a95 admin admin] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:33:57.794279 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG oslo_concurrency.lockutils [None req-39561063-7ce1-4c9e-91d6-a99b81928a95 admin admin] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:33:57.794697 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: DEBUG oslo_concurrency.lockutils [None req-39561063-7ce1-4c9e-91d6-a99b81928a95 admin admin] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:33:57.818013 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: INFO nova.api.openstack.requestlog [None req-39561063-7ce1-4c9e-91d6-a99b81928a95 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.080184 Sep 25 04:33:57.818567 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: [pid: 105643|app: 0|req: 39/76] 10.222.0.25 () {60 vars in 1193 bytes} [Sun Sep 25 04:33:57 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 04:34:56.289245 dv-cinder-855359-5-iscsi devstack@n-api.service[105642]: Sun Sep 25 04:34:56 2022 - graceful shutdown triggered... Sep 25 04:34:56.288991 dv-cinder-855359-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 25 04:34:56.290219 dv-cinder-855359-5-iscsi devstack@n-api.service[105643]: Gracefully killing worker 1 (pid: 105643)... Sep 25 04:34:56.290591 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: Gracefully killing worker 2 (pid: 105644)... Sep 25 04:34:56.416699 dv-cinder-855359-5-iscsi devstack@n-api.service[105644]: DEBUG dbcounter [-] [105644] Writing DB stats nova_api:SELECT=4 {{(pid=105644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:34:57.290027 dv-cinder-855359-5-iscsi devstack@n-api.service[105642]: worker 1 buried after 1 seconds Sep 25 04:34:57.290587 dv-cinder-855359-5-iscsi devstack@n-api.service[105642]: worker 2 buried after 1 seconds Sep 25 04:34:57.290587 dv-cinder-855359-5-iscsi devstack@n-api.service[105642]: goodbye to uWSGI. Sep 25 04:34:57.291619 dv-cinder-855359-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 25 04:34:57.292184 dv-cinder-855359-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 25 04:34:57.295030 dv-cinder-855359-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 25 04:34:57.306000 dv-cinder-855359-5-iscsi devstack@n-api.service[127125]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 25 04:34:57.308073 dv-cinder-855359-5-iscsi devstack@n-api.service[127125]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Sep 25 04:34:57 2022] *** Sep 25 04:34:57.308073 dv-cinder-855359-5-iscsi devstack@n-api.service[127125]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 25 04:34:57.308073 dv-cinder-855359-5-iscsi devstack@n-api.service[127125]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 25 04:34:57.308073 dv-cinder-855359-5-iscsi devstack@n-api.service[127125]: nodename: dv-cinder-855359-5-iscsi Sep 25 04:34:57.308073 dv-cinder-855359-5-iscsi devstack@n-api.service[127125]: machine: x86_64 Sep 25 04:34:57.308073 dv-cinder-855359-5-iscsi devstack@n-api.service[127125]: clock source: unix Sep 25 04:34:57.308073 dv-cinder-855359-5-iscsi devstack@n-api.service[127125]: pcre jit disabled Sep 25 04:34:57.308073 dv-cinder-855359-5-iscsi devstack@n-api.service[127125]: detected number of CPU cores: 4 Sep 25 04:34:57.308073 dv-cinder-855359-5-iscsi devstack@n-api.service[127125]: current working directory: / Sep 25 04:34:57.308073 dv-cinder-855359-5-iscsi devstack@n-api.service[127125]: detected binary path: /usr/bin/uwsgi-core Sep 25 04:34:57.308881 dv-cinder-855359-5-iscsi devstack@n-api.service[127125]: your processes number limit is 47680 Sep 25 04:34:57.308881 dv-cinder-855359-5-iscsi devstack@n-api.service[127125]: your memory page size is 4096 bytes Sep 25 04:34:57.308881 dv-cinder-855359-5-iscsi devstack@n-api.service[127125]: detected max file descriptor number: 2048 Sep 25 04:34:57.308881 dv-cinder-855359-5-iscsi devstack@n-api.service[127125]: lock engine: pthread robust mutexes Sep 25 04:34:57.308881 dv-cinder-855359-5-iscsi devstack@n-api.service[127125]: thunder lock: enabled Sep 25 04:34:57.308881 dv-cinder-855359-5-iscsi devstack@n-api.service[127125]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 25 04:34:57.308881 dv-cinder-855359-5-iscsi devstack@n-api.service[127125]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 25 04:34:57.352854 dv-cinder-855359-5-iscsi devstack@n-api.service[127125]: Python main interpreter initialized at 0x55ed7a3a19c0 Sep 25 04:34:57.352854 dv-cinder-855359-5-iscsi devstack@n-api.service[127125]: python threads support enabled Sep 25 04:34:57.352854 dv-cinder-855359-5-iscsi devstack@n-api.service[127125]: your server socket listen backlog is limited to 100 connections Sep 25 04:34:57.352854 dv-cinder-855359-5-iscsi devstack@n-api.service[127125]: your mercy for graceful operations on workers is 90 seconds Sep 25 04:34:57.353314 dv-cinder-855359-5-iscsi devstack@n-api.service[127125]: mapped 403077 bytes (393 KB) for 2 cores Sep 25 04:34:57.353314 dv-cinder-855359-5-iscsi devstack@n-api.service[127125]: *** Operational MODE: preforking *** Sep 25 04:34:57.353609 dv-cinder-855359-5-iscsi devstack@n-api.service[127125]: *** uWSGI is running in multiple interpreter mode *** Sep 25 04:34:57.353609 dv-cinder-855359-5-iscsi devstack@n-api.service[127125]: spawned uWSGI master process (pid: 127125) Sep 25 04:34:57.353788 dv-cinder-855359-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 25 04:34:57.356394 dv-cinder-855359-5-iscsi devstack@n-api.service[127125]: spawned uWSGI worker 1 (pid: 127141, cores: 1) Sep 25 04:34:57.356948 dv-cinder-855359-5-iscsi devstack@n-api.service[127125]: spawned uWSGI worker 2 (pid: 127142, cores: 1) Sep 25 04:34:57.357256 dv-cinder-855359-5-iscsi devstack@n-api.service[127125]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 25 04:34:58.021673 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 25 04:34:58.022284 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 25 04:34:59.198671 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 25 04:34:59.198671 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: from cryptography.utils import int_from_bytes Sep 25 04:34:59.199276 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 25 04:34:59.199276 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: from cryptography.utils import int_from_bytes Sep 25 04:34:59.204328 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 25 04:34:59.204328 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: from cryptography.utils import int_from_bytes Sep 25 04:34:59.204799 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 25 04:34:59.204799 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: from cryptography.utils import int_from_bytes Sep 25 04:35:01.649310 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 25 04:35:01.649900 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 25 04:35:01.650271 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 25 04:35:01.650657 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 25 04:35:01.650920 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 25 04:35:01.651343 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.651648 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.652078 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.652292 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.652758 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.653202 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.653295 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.653589 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.653962 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.654349 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.654755 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.655191 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855359-5-iscsi {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.655646 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.656089 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.656438 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.656880 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.660887 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.660887 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.660887 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.660887 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.660887 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.660887 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.661541 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.661541 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.661541 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.661541 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.661541 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.661541 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.661541 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.662081 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.662081 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855359-5-iscsi {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.662553 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.662683 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.662910 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.663332 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.663657 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.663968 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.664295 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.664610 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.664956 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.665283 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.665802 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.666308 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.666801 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.667270 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.667603 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.667911 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.668225 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.668544 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.668899 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.669172 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.669460 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.669786 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.670114 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.670440 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.670695 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.670949 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.671277 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.672286 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.672781 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.673211 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.673774 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.674303 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.674827 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.675351 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.675486 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 25 04:35:01.675922 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 25 04:35:01.676248 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 25 04:35:01.676615 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 25 04:35:01.676898 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 25 04:35:01.677147 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.677286 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.677747 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.677963 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.678273 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.678607 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.678781 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.679220 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.679386 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.679722 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.680020 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.680233 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.680675 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.680889 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.681247 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.681464 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.681746 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.682099 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.682269 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.682696 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.682877 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.683196 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.683450 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.683618 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.683787 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.684132 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.684272 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855359-5-iscsi {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.684454 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.684586 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.684935 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.685090 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.685262 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.685572 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.685685 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.685956 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.686070 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.686246 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.686359 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.686791 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.687842 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.688013 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.688243 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.688526 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.688662 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.688891 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.689010 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.689350 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.689527 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.689653 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.689976 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.690306 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.690459 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.690617 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.690950 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.691238 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.691343 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.691815 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.691993 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855359-5-iscsi {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.692218 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.692332 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.692574 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.692851 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.692971 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.693051 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.693263 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.693397 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.693688 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.693865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.693999 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.694331 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.694442 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.694634 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.694749 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.694961 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.695078 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.695283 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.695411 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.695602 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.695712 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.695921 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.696051 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.696240 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.696341 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.696570 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.696740 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.696881 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.697020 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.697274 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.697589 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.697858 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.697975 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.698191 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.698304 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.698518 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.698716 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.698883 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.699092 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.699254 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.699400 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.699571 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.699732 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.699956 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.700110 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.700255 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.700401 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.700588 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.700807 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.700959 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.701140 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.701288 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.701444 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.701618 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.701767 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.701931 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.702084 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.702230 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.702383 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.702539 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.702734 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.702946 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.703096 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.703282 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.704022 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.704191 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.704351 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.704505 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.704706 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.704911 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.705078 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.705235 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.705382 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.705533 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.705692 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.705840 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.706000 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.706157 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.706579 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.706735 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.706882 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.707034 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.707400 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.707400 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.707825 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.707825 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.708115 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.708261 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.708418 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.708572 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.708791 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.708990 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.709146 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.709303 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.709458 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.709612 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.709759 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.709915 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.710069 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.710224 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.710377 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.710526 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.710671 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.710836 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.710989 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.711144 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.711334 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.711494 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.711642 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.711795 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.711952 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.712106 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.712252 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.712404 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.712551 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.712715 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.712965 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.713154 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.713154 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.713446 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.713599 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.714088 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.714258 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.714414 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.714568 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.714725 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.714879 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.715033 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.715193 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.715396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.715561 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.715720 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.715874 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.716020 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.716258 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.716418 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.716575 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.716758 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.716951 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.717150 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.717406 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.717406 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.718073 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.718223 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.718394 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.718559 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.718707 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.718862 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.719017 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.719163 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.719309 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.719673 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.719827 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.719982 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.720163 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.720318 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.720473 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.720630 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.720812 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.721003 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.721205 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.721355 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.721502 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.721648 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.721648 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.721941 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.722088 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.722432 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.722432 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.722736 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.722899 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.723107 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.723257 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.723411 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.723558 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.723703 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.724201 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.724377 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.724541 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.724747 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.724929 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.725095 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.725249 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.725395 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.725565 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.725721 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.725721 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.726010 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.726167 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.726314 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.726510 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.726669 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.726815 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.726979 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.727126 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.727298 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.728387 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.728556 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.728736 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.728896 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.729087 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.729287 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.729448 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.729603 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.729758 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.729905 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.730068 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.730225 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.730371 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.730518 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.730663 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 04:35:01.730823 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.730976 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.731132 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.731277 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.731424 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.731577 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.731739 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.731739 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.732048 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.732201 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.732348 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.732497 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.733314 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.733492 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.733643 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.733790 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.735500 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.735677 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.735840 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.735989 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.736143 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.736293 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.736577 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.736825 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.737075 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.737328 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.737516 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.737699 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.738230 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.738443 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.738628 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.738792 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.738940 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.739097 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.739245 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.739435 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.739586 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.739773 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.739933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.740094 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.740251 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.740397 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.740577 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.740808 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.740977 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.741175 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.741327 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.741474 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.741652 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.741840 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.742001 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.742165 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.742323 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.742323 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.742618 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.742772 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.742944 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.742944 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.743278 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.743439 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.743587 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.743765 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.743956 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.744109 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.744257 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.744412 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.744582 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.745031 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.745031 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.745519 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.745519 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.745848 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.746034 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.746196 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.746597 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.746764 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.746921 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.747075 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.747232 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.747388 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.747544 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.748593 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.748752 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.748854 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.748957 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.749058 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.749157 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.749248 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.749343 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.749439 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.749535 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.750249 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.750431 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.750535 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.750642 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.750732 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.750834 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.750924 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.751019 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.751019 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.751200 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.751313 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.751413 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.751503 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.751590 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.751684 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.751773 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.751867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.751964 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.752052 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.752138 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.752232 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.752321 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.752412 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.752507 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.752602 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.752725 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.752827 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.752924 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.753021 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.753111 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.753197 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.753284 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.753374 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.753463 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.753564 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.753653 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.753740 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.753826 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.753912 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.753999 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.754098 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.754194 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.754281 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.754376 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.754471 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.754560 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.754656 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.754752 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.754847 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.754937 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.755020 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.755095 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.755179 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.755273 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.755362 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.755457 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.755554 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.755646 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.755646 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.755809 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.755809 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.755986 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.756075 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.756170 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.756259 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.756353 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.756441 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.756536 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.756624 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.756950 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.757107 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.757201 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.757201 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.757370 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.757464 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.757563 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.757659 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.757747 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.757840 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.757935 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.758037 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.758133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.758227 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.758321 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.758410 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.758503 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.758643 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.758739 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.758827 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.758920 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.759009 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.759107 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.759208 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.759306 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.759402 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.759497 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.759593 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.759688 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.759789 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.759879 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.759973 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.760069 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.760158 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.760254 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.760342 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.760429 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.760514 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.760608 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.760797 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.760964 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.761064 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.761154 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.761248 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.761346 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.761484 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.761597 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.761688 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.761776 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.761870 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.761959 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.762046 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.762146 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.762243 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.762343 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.762439 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.762527 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.762887 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.762887 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.763085 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.763175 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.763262 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.763355 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.763452 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.763536 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.763624 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.763711 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.763797 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.763884 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.763979 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.764069 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.764155 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.764249 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.764337 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.764424 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.764524 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.764620 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.765028 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.765120 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.765220 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.765314 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.765601 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.765701 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.765778 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.766058 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.766160 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.766371 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.766480 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.766684 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.766800 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.767034 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.767133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.767313 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.767411 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.767626 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.767730 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.767938 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.768033 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.768251 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.768380 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.768564 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.768820 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.768968 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.769160 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.769258 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.769524 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.769655 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.769863 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.769971 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.770166 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.770409 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.770521 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.770742 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.770848 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.771063 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.771269 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.771605 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.771975 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.772350 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.772448 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.772852 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.773099 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.773294 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.773395 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.773614 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.773707 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.773782 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.774020 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.774124 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.774315 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.774426 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.774619 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.774721 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.774919 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.775173 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.775285 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.775470 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.775604 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.775847 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.776161 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.776385 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.776493 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.776734 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.776981 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.777099 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.777293 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.777447 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.777610 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.777773 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.777934 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.778086 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.778263 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.778427 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.778588 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.778742 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.778914 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.779237 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.779407 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.779569 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.779732 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.779893 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.780046 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.780206 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.780360 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.780526 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.780728 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.781075 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.781285 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.781285 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.781617 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.781794 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.781957 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.782111 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.782271 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.782433 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.782586 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.782748 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.782917 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.783082 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.783235 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.783396 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.783572 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.783746 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.783902 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.784056 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.784217 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.784380 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.784583 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.784767 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.784923 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.785099 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.785271 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.785497 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.785670 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.785832 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.785987 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.786140 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.786404 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.786570 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.786735 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.786896 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.787085 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.787244 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.787409 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.787562 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.787729 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.787890 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.788042 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.788202 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.788356 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.788522 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.788708 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.788876 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.789065 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.789256 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.789444 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.789621 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.789775 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.789938 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.790092 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.790245 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.790398 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.790559 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.790720 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.790873 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.791025 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.791183 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.791337 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.791514 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.791676 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.791836 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.791990 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.792142 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.792379 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.792534 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.792775 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.792936 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.793100 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.793262 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.793430 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.793584 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.793755 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.793916 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.794083 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.794083 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.794389 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.794551 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.794711 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.794872 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.795032 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.795192 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.795353 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.795640 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.795807 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.795978 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.795978 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.796299 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.797198 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.797378 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.797569 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.797743 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.797898 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.798050 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.798202 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.798361 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.798523 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.798687 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.798860 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.799014 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.799166 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.799319 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.799554 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.799711 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.799863 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.800025 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.800178 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.800345 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.800513 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.800687 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.800868 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.801023 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.801183 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.801336 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.801499 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.801661 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.801816 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.802112 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.802287 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.802444 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.802612 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.802768 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.802929 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.803093 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.803248 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.803420 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.803574 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.803726 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.803886 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.804039 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.804199 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.804367 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.804528 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.804715 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.804875 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.805028 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.805192 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.805363 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.805525 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.805765 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.805925 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.806095 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.806249 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.806411 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.806565 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.806723 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.806880 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.806880 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.807294 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.807473 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.807638 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.807798 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.807952 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.808105 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.808267 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.808420 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.808573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.808573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.808953 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.809119 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.809287 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.809449 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.809621 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.809784 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.809946 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.810100 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.810263 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.810416 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.810613 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.810769 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.810929 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.811090 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.811254 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.811407 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.811570 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.811721 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.811873 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.812034 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.813280 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.813389 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.813501 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.813603 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.813701 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.813819 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.813910 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.813996 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.814081 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.814166 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.814251 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.814345 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.814440 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.814527 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.814620 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.814706 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.814805 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.814905 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.815000 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.815088 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.815173 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.815257 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.815350 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.815443 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.815537 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.815624 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.815708 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.815850 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.815955 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.816043 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.816134 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.816224 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.816317 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.816411 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.816521 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.816615 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.816730 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.816819 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.816903 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.816987 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.817081 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.817168 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.817269 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.817368 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.817452 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.817548 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.817642 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.817735 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.817840 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.817931 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.818006 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.818099 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.818187 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.818272 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.818356 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.818468 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.818562 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.818661 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.818661 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.818826 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.818911 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.818996 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.819088 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.819182 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.819276 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.819363 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.819663 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.819775 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.819878 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.819966 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.820051 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.820143 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.820230 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.820322 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.820417 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.820511 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.820598 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.820793 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.820964 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.821103 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.821275 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.821409 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.821585 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.821718 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.821889 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.822029 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.822239 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.822345 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.822545 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.822758 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.822908 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.823077 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.823224 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.823409 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.823541 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.823803 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.823905 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.824119 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.824212 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.824434 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.824534 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.824785 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.824881 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.825094 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.825189 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.825424 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.825524 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.825735 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.825860 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.826189 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.826292 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.826369 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.826453 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.826712 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.826878 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.827032 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.827184 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.827336 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.827626 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.827843 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.828040 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.828040 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.828348 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.828500 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.828706 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.828879 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.829045 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.829205 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.829405 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.829569 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.829829 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.829829 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.830153 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.830314 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.830475 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.830634 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.830788 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.830962 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.831124 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.831536 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.831689 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.831841 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.832072 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.832242 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.832405 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.832566 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.832764 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.833037 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.833198 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.833372 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.833527 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.833687 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.833973 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.834142 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.834297 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.834459 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.834613 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.834773 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.834926 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.835078 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.835282 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.835446 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.835619 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.835782 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.835782 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.836101 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.836342 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.836510 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.836703 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.836875 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.837039 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.837200 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.837363 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.837524 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.837793 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.837962 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.838132 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.838288 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.838441 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.838601 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.838755 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.838914 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.839082 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.839236 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.839389 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.839543 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.839696 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.839946 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.840135 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.840300 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.840454 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.840615 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.840814 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.840980 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.841141 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.841294 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.841448 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.841629 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.841784 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.841946 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.841946 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.842258 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.842417 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.842581 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.842735 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.842897 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.843062 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.843216 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.843398 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.843554 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.843554 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.843870 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.844024 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.844200 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.844200 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.844492 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.844492 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.844825 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.844980 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.845132 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.845283 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.845481 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.845653 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.845840 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.846007 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.846169 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.846354 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.846354 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.846744 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.846908 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.847063 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.847223 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.847383 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.847538 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.847705 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.847959 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.848118 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.848286 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.848459 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.848623 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.848817 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.848972 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.849136 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.849304 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.849458 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.849694 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.849850 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.850039 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.850194 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.850348 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.850500 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.850746 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.850917 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.851081 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.851243 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.851404 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.851558 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.851725 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.851878 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.852032 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.852193 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.852346 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.852508 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.852695 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.852867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.853030 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.853194 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.853355 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.853518 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.853672 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.853824 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.853978 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.854146 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.854309 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.854471 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.854632 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.854799 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.854963 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.855116 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.855269 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.855436 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.855598 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.855751 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.855911 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.856064 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.856064 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.856376 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.856530 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.856802 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.856985 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.857139 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.857303 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.857465 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.857626 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.857780 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.857949 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.858196 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.858372 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.858538 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.858692 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.858845 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.859541 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.859715 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.859884 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.860039 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.860203 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.860357 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.860518 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.860705 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.860878 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.861033 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.861193 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.861355 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.861552 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.861735 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.861932 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.862098 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.862260 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.862414 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.862568 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.862735 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.862890 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.863044 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.863196 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.863363 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.863533 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.863706 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.863860 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.864013 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.864165 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.864326 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.864489 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.864489 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.864830 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.864994 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.865154 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.865314 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.865477 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.865630 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.865801 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.865962 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.866115 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.866281 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.866434 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.866594 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.866757 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.867007 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.867182 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.867346 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.867507 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.867660 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.867838 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.868000 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.868154 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.868425 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.868583 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.868773 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.868930 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.869089 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.869252 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.869412 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.869412 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.869710 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.869865 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.870028 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.870190 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.870351 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.870511 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.870672 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.870833 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.870987 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.871147 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.871300 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.871459 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.871613 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.871774 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.871928 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.872101 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.872262 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.872414 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.872567 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.872758 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.872925 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.873080 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.873238 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.873396 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.873557 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.873718 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.873881 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.874050 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.874210 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.874363 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.874515 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.874743 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.875414 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.875635 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.875807 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.875960 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.876121 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.876121 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.876423 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.876423 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.876755 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.876864 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.876960 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.877072 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.877155 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.877240 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.877334 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.877412 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.877412 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.877557 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.877634 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.877716 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.877793 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.877868 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.877950 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.878035 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.878119 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.878196 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.878272 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.878353 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.878438 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.878523 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.878607 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.878711 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.878788 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.878863 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.879017 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.879098 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.879181 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.879264 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.879341 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.879416 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.879416 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.879562 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.879664 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.879751 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.879830 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.879918 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.879996 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.880412 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.880541 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.880687 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.880828 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.880941 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.881041 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.881130 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.881225 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.881371 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.881556 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.881729 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.881895 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.882056 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.882210 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.882370 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.882539 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.882694 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.882848 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.883007 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.883160 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.883319 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.883483 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.883643 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.883839 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.883998 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.884152 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.884313 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.884478 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.884631 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.884827 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.884989 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.885141 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.885293 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.885457 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.885788 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.885955 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.886119 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.886270 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.886434 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.886628 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.886788 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.887036 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.887277 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.887451 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.887620 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.887774 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.887927 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.888087 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.888247 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.888411 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.888589 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.888802 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.888958 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.889209 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.889370 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.889522 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.889687 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.889871 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.890141 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.890446 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.890609 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.890811 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.890981 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.891212 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.891380 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.891683 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.891852 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.892090 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.892249 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.892409 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.892604 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.892801 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.893049 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.893222 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.893388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.893580 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.893745 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.893979 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.894144 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.894312 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.894473 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.894628 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.894787 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.894948 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.895116 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.895269 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.895440 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.895608 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.895769 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.895933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.896102 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.896275 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.896999 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.897189 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.897431 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.897599 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.897766 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.897929 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.898083 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.898256 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.898410 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.898572 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.898725 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.898885 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.899039 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.899192 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.899389 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.899560 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.899715 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.899868 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.900020 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.900181 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.900345 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.900512 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.900695 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.900868 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.901029 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.901189 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.901350 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.901516 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.901670 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.901846 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.902108 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.902267 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.902452 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.902613 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.902767 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.902931 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.903084 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.903244 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.903412 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.903568 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.903728 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.903881 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.904042 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.904195 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.904195 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.904509 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.904682 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.904842 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.905005 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.905173 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.905327 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.905480 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.905633 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.906315 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.906481 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.906646 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.906923 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.907107 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.907272 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.907446 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.907673 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.907843 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.907843 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.908142 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.908295 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.908455 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.908616 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.908825 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.908998 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.909156 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.909321 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.909473 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.909635 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.910142 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.910307 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.910461 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.910613 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.910769 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.911003 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.911159 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.911311 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.911463 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.911626 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.911780 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.911945 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.912105 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.912267 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.912420 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.912579 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.912789 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.912947 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.913088 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.913227 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.913372 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.913514 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.913676 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.913827 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.913973 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.914123 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.914272 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.914415 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.914572 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.914741 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.914894 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.915055 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.915216 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.915377 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.915543 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.915708 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.915862 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.916016 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.916175 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.916343 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.916496 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.916699 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.916870 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.917032 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.917190 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.917362 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.917362 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.917685 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.917921 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.918088 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.918088 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.918390 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.918551 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.918711 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.918863 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.919015 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.919181 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.919335 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.919486 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.919640 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.919811 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.919973 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.920135 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.920297 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.920297 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.920601 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.920782 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.920946 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.921113 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.921275 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.921468 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.922204 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.922596 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.922758 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.922923 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.923086 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.923240 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.923396 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.923549 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.923716 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.923885 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.924046 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.924207 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.924369 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.924530 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.924744 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.924913 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.925066 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.925226 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.925386 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.925386 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.925729 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.925729 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.926068 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.926226 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.926395 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.926560 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.926728 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.926890 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.927042 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.927195 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.927354 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.927521 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.927676 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.927676 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.928064 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.928224 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.928385 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.928549 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.928728 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.928905 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.929060 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.929211 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.929374 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.929527 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.929688 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.929841 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.930000 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.930161 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.930323 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.930484 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.930646 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.930821 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.930974 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.931134 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.931302 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.931462 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.931614 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.931775 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.931927 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.932079 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.932244 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.932406 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.932565 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.932769 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.932935 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.933102 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.933257 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.933416 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.933416 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.933714 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.933875 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.934037 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.934200 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.934354 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.934505 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.934658 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.934817 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.934991 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.934991 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 25 04:35:01.935292 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.935292 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.935292 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.935292 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.935292 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.935292 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.935292 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.935292 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.936502 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.936502 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.936502 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.936502 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.936502 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.936502 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.936502 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.936502 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.937837 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.937837 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.937837 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.937837 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.937837 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.937837 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.938809 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.938809 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.938809 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.939264 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.939264 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.939568 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.939793 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.940106 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.940415 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.940751 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.941070 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.941385 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.941710 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.942035 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.942344 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.942668 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.942995 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.943342 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.943655 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.943998 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.944325 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.944661 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.944977 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.945285 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 04:35:01.945528 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 25 04:35:01.994306 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO dbcounter [None req-b34c56a4-a4a4-4f29-8f07-535c77546a44 None None] Registered counter for database nova_api Sep 25 04:35:02.008105 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO dbcounter [None req-bcd7cecc-131a-427e-9ed9-7b685d8ecd74 None None] Registered counter for database nova_api Sep 25 04:35:02.014609 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_db.sqlalchemy.engines [None req-b34c56a4-a4a4-4f29-8f07-535c77546a44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127142) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 04:35:02.021412 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writer thread running {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 04:35:02.028334 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_db.sqlalchemy.engines [None req-bcd7cecc-131a-427e-9ed9-7b685d8ecd74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127141) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 04:35:02.035744 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writer thread running {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 04:35:02.079233 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.context [None req-b34c56a4-a4a4-4f29-8f07-535c77546a44 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),adc1fa50-82a8-468b-9dc8-c203e45a28ca(cell1) {{(pid=127142) load_cells /opt/stack/nova/nova/context.py:464}} Sep 25 04:35:02.083523 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b34c56a4-a4a4-4f29-8f07-535c77546a44 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:35:02.084003 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b34c56a4-a4a4-4f29-8f07-535c77546a44 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:35:02.085623 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b34c56a4-a4a4-4f29-8f07-535c77546a44 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:35:02.086346 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b34c56a4-a4a4-4f29-8f07-535c77546a44 None None] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:35:02.086798 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b34c56a4-a4a4-4f29-8f07-535c77546a44 None None] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:35:02.088847 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b34c56a4-a4a4-4f29-8f07-535c77546a44 None None] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:35:02.090846 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO dbcounter [None req-b34c56a4-a4a4-4f29-8f07-535c77546a44 None None] Registered counter for database nova_cell0 Sep 25 04:35:02.093155 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.context [None req-bcd7cecc-131a-427e-9ed9-7b685d8ecd74 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),adc1fa50-82a8-468b-9dc8-c203e45a28ca(cell1) {{(pid=127141) load_cells /opt/stack/nova/nova/context.py:464}} Sep 25 04:35:02.095145 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO dbcounter [None req-b34c56a4-a4a4-4f29-8f07-535c77546a44 None None] Registered counter for database nova_cell1 Sep 25 04:35:02.097581 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bcd7cecc-131a-427e-9ed9-7b685d8ecd74 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:35:02.098063 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bcd7cecc-131a-427e-9ed9-7b685d8ecd74 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:35:02.101540 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bcd7cecc-131a-427e-9ed9-7b685d8ecd74 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:35:02.101540 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bcd7cecc-131a-427e-9ed9-7b685d8ecd74 None None] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:35:02.101540 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bcd7cecc-131a-427e-9ed9-7b685d8ecd74 None None] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:35:02.102415 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_db.sqlalchemy.engines [None req-b34c56a4-a4a4-4f29-8f07-535c77546a44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127142) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 04:35:02.102869 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bcd7cecc-131a-427e-9ed9-7b685d8ecd74 None None] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:35:02.104146 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_db.sqlalchemy.engines [None req-b34c56a4-a4a4-4f29-8f07-535c77546a44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127142) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 04:35:02.104966 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO dbcounter [None req-bcd7cecc-131a-427e-9ed9-7b685d8ecd74 None None] Registered counter for database nova_cell0 Sep 25 04:35:02.109041 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO dbcounter [None req-bcd7cecc-131a-427e-9ed9-7b685d8ecd74 None None] Registered counter for database nova_cell1 Sep 25 04:35:02.110763 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writer thread running {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 04:35:02.112135 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writer thread running {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 04:35:02.116574 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_db.sqlalchemy.engines [None req-bcd7cecc-131a-427e-9ed9-7b685d8ecd74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127141) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 04:35:02.118249 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_db.sqlalchemy.engines [None req-bcd7cecc-131a-427e-9ed9-7b685d8ecd74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127141) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 04:35:02.124043 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writer thread running {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 04:35:02.127464 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writer thread running {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 04:35:02.267446 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO dbcounter [None req-b34c56a4-a4a4-4f29-8f07-535c77546a44 None None] Registered counter for database nova_cell0 Sep 25 04:35:02.276517 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_db.sqlalchemy.engines [None req-b34c56a4-a4a4-4f29-8f07-535c77546a44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127142) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 04:35:02.281678 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writer thread running {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 04:35:02.288551 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO dbcounter [None req-bcd7cecc-131a-427e-9ed9-7b685d8ecd74 None None] Registered counter for database nova_cell0 Sep 25 04:35:02.295057 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_db.sqlalchemy.engines [None req-bcd7cecc-131a-427e-9ed9-7b685d8ecd74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127141) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 04:35:02.301430 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writer thread running {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 04:35:02.602976 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: WARNING keystonemiddleware.auth_token [None req-b34c56a4-a4a4-4f29-8f07-535c77546a44 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 25 04:35:02.611028 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: WARNING keystonemiddleware.auth_token [None req-b34c56a4-a4a4-4f29-8f07-535c77546a44 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 25 04:35:02.627592 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: WARNING keystonemiddleware.auth_token [None req-bcd7cecc-131a-427e-9ed9-7b685d8ecd74 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 25 04:35:02.633692 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: WARNING keystonemiddleware.auth_token [None req-bcd7cecc-131a-427e-9ed9-7b685d8ecd74 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 25 04:35:02.956777 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: WARNING keystonemiddleware.auth_token [None req-b34c56a4-a4a4-4f29-8f07-535c77546a44 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 25 04:35:02.962765 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: WARNING keystonemiddleware.auth_token [None req-b34c56a4-a4a4-4f29-8f07-535c77546a44 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 25 04:35:02.968101 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ed7a3a19c0 pid: 127142 (default app) Sep 25 04:35:02.981306 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: WARNING keystonemiddleware.auth_token [None req-bcd7cecc-131a-427e-9ed9-7b685d8ecd74 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 25 04:35:02.987346 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: WARNING keystonemiddleware.auth_token [None req-bcd7cecc-131a-427e-9ed9-7b685d8ecd74 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 25 04:35:02.992757 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ed7a3a19c0 pid: 127141 (default app) Sep 25 04:35:54.176356 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_api:SELECT=3 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:54.177280 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=3 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:54.178783 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell0:SELECT=3 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:54.182353 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell0:SELECT=3 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:54.582300 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_api:SELECT=3 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:54.583121 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=3 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:54.584927 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell0:SELECT=3 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:54.585805 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell0:SELECT=3 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:35:54.882130 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-67f8f579-24df-4656-a51e-e0e306db00bb tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-793791225", "imageRef": "e5cfdbb2-d0ce-4736-b311-1a3c155844e9", "flavorRef": "452", "networks": [{"uuid": "30366145-db86-4362-aa94-3333a61ae128"}]}} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:35:55.329922 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-ec66d90a-1aa8-4d4a-bf34-12885785c9b9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1699491629", "imageRef": "e5cfdbb2-d0ce-4736-b311-1a3c155844e9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:35:55.772258 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.network.neutron [None req-67f8f579-24df-4656-a51e-e0e306db00bb tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] validate_networks() for [('30366145-db86-4362-aa94-3333a61ae128', None, None, None, None, None)] {{(pid=127142) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 04:35:55.940694 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.network.neutron [None req-ec66d90a-1aa8-4d4a-bf34-12885785c9b9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] validate_networks() for [('80b6de49-451b-443e-9218-1f0470a46dc2', None, None, None, None, None)] {{(pid=127141) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 04:35:57.415832 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-67f8f579-24df-4656-a51e-e0e306db00bb tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Flavor limits 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 04:35:57.417053 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-67f8f579-24df-4656-a51e-e0e306db00bb tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Image limits 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 04:35:57.417915 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-67f8f579-24df-4656-a51e-e0e306db00bb tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Flavor pref 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 04:35:57.418600 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-67f8f579-24df-4656-a51e-e0e306db00bb tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Image pref 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 04:35:57.419374 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-67f8f579-24df-4656-a51e-e0e306db00bb tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 04:35:57.459631 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-67f8f579-24df-4656-a51e-e0e306db00bb tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:35:57.460366 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-67f8f579-24df-4656-a51e-e0e306db00bb tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:35:57.460973 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-67f8f579-24df-4656-a51e-e0e306db00bb tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:35:57.461843 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-67f8f579-24df-4656-a51e-e0e306db00bb tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:35:57.462915 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-67f8f579-24df-4656-a51e-e0e306db00bb tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:35:57.463496 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-67f8f579-24df-4656-a51e-e0e306db00bb tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:35:57.541327 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.quota [None req-67f8f579-24df-4656-a51e-e0e306db00bb tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Getting quotas for project 80e5b6ce14ab47dfac99cc80153d7735. Resources: {'instances', 'ram', 'cores'} {{(pid=127142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 04:35:57.562921 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.quota [None req-67f8f579-24df-4656-a51e-e0e306db00bb tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Getting quotas for user 1d1bf78eb0a94bab884b1df13c081096 and project 80e5b6ce14ab47dfac99cc80153d7735. Resources: {'instances', 'ram', 'cores'} {{(pid=127142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 04:35:57.588330 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-67f8f579-24df-4656-a51e-e0e306db00bb tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Going to run 1 instances... {{(pid=127142) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 04:35:57.597137 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-67f8f579-24df-4656-a51e-e0e306db00bb tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5cfdbb2-d0ce-4736-b311-1a3c155844e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 04:35:57.672145 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-ec66d90a-1aa8-4d4a-bf34-12885785c9b9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Flavor limits 0:0:0 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 04:35:57.672626 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-ec66d90a-1aa8-4d4a-bf34-12885785c9b9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Image limits 0:0:0 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 04:35:57.673751 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-ec66d90a-1aa8-4d4a-bf34-12885785c9b9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Flavor pref 0:0:0 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 04:35:57.674341 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-ec66d90a-1aa8-4d4a-bf34-12885785c9b9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Image pref 0:0:0 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 04:35:57.674978 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-ec66d90a-1aa8-4d4a-bf34-12885785c9b9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 04:35:57.716195 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ec66d90a-1aa8-4d4a-bf34-12885785c9b9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:35:57.721037 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ec66d90a-1aa8-4d4a-bf34-12885785c9b9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:35:57.721494 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ec66d90a-1aa8-4d4a-bf34-12885785c9b9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:35:57.722275 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ec66d90a-1aa8-4d4a-bf34-12885785c9b9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:35:57.723993 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ec66d90a-1aa8-4d4a-bf34-12885785c9b9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:35:57.724470 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ec66d90a-1aa8-4d4a-bf34-12885785c9b9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:35:57.769865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-67f8f579-24df-4656-a51e-e0e306db00bb tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.599364 Sep 25 04:35:57.778209 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 1/1] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 25 04:35:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 3610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 04:35:57.837736 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.quota [None req-ec66d90a-1aa8-4d4a-bf34-12885785c9b9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Getting quotas for project f6f23cf0323f48069e21acf059cbd1f0. Resources: {'instances', 'ram', 'cores'} {{(pid=127141) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 04:35:57.880339 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.quota [None req-ec66d90a-1aa8-4d4a-bf34-12885785c9b9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Getting quotas for user 2666d4774776498bbdbce539296e76a9 and project f6f23cf0323f48069e21acf059cbd1f0. Resources: {'instances', 'ram', 'cores'} {{(pid=127141) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 04:35:57.908750 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-ec66d90a-1aa8-4d4a-bf34-12885785c9b9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Going to run 1 instances... {{(pid=127141) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 04:35:57.924742 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-ec66d90a-1aa8-4d4a-bf34-12885785c9b9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 8a4fe760-3afd-42e5-9909-86ca268c9b96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5cfdbb2-d0ce-4736-b311-1a3c155844e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127141) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 04:35:58.152958 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-ec66d90a-1aa8-4d4a-bf34-12885785c9b9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.577510 Sep 25 04:35:58.155192 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 1/2] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 25 04:35:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 3581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 04:35:58.163529 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-e4723df6-2ae8-4ba2-88cd-c4669155ad8f tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:35:58.173029 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-e4723df6-2ae8-4ba2-88cd-c4669155ad8f tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:35:58.224397 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-5111a732-e89c-4faf-b29d-a026254ae88c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Action: 'create', calling method: .version_select at 0x7f4d3f33f3a0>, body: {"keypair": {"name": "tempest-keypair-38398811", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVn3+asVUICLtP+nuFL7MNU4ZC/47xOFN51UGNZbwUTG8weYasuW6zHohueHfq8M/haf+pXma6xuc1GjqGe5uEJyv+jFnIBV4NcKGvEkzHpbpSl3cPX7ltDWGADpV3Wxg=="}} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:35:58.310232 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.quota [None req-5111a732-e89c-4faf-b29d-a026254ae88c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Getting quotas for project 5ead2221f7f54d6cbea9fc086a089342. Resources: {'key_pairs'} {{(pid=127142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 04:35:58.322635 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.quota [None req-5111a732-e89c-4faf-b29d-a026254ae88c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Getting quotas for user c50ba6f9a164463eae9a248936e7bf80 and project 5ead2221f7f54d6cbea9fc086a089342. Resources: {'key_pairs'} {{(pid=127142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 04:35:58.454728 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-5111a732-e89c-4faf-b29d-a026254ae88c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.675142 Sep 25 04:35:58.469096 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 2/3] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 25 04:35:57 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:35:58.484602 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-6975e36c-d727-4ff7-9af1-71d8ca577060 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:35:58.485168 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-6975e36c-d727-4ff7-9af1-71d8ca577060 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 8a4fe760-3afd-42e5-9909-86ca268c9b96] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:35:58.658999 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-e4723df6-2ae8-4ba2-88cd-c4669155ad8f tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:35:58.711643 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-e4723df6-2ae8-4ba2-88cd-c4669155ad8f tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1214 microversion: 2.1 time: 0.554809 Sep 25 04:35:58.712384 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:35:58 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1214 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:35:58.791682 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-6975e36c-d727-4ff7-9af1-71d8ca577060 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:35:58.834574 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-6975e36c-d727-4ff7-9af1-71d8ca577060 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96" status: 200 len: 1222 microversion: 2.1 time: 0.363949 Sep 25 04:35:58.835178 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 3/5] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:35:58 2022] GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96 => generated 1222 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:35:59.083876 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-54feb216-a472-46b0-b2f7-d8dc7cea2ff4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1586966635", "imageRef": "e5cfdbb2-d0ce-4736-b311-1a3c155844e9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:35:59.209495 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.network.neutron [None req-54feb216-a472-46b0-b2f7-d8dc7cea2ff4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] validate_networks() for [('80b6de49-451b-443e-9218-1f0470a46dc2', None, None, None, None, None)] {{(pid=127141) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 04:35:59.743011 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-c7699910-4a47-4443-9061-7e1ebc45e397 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:35:59.743984 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-c7699910-4a47-4443-9061-7e1ebc45e397 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:35:59.966374 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-c7699910-4a47-4443-9061-7e1ebc45e397 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:35:59.978702 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-c7699910-4a47-4443-9061-7e1ebc45e397 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1214 microversion: 2.1 time: 0.240773 Sep 25 04:35:59.999097 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 4/6] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:35:59 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1214 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:01.029013 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-fdb96825-7baa-4ce5-a492-8b364e876c99 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:01.030901 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-fdb96825-7baa-4ce5-a492-8b364e876c99 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:01.063720 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fdb96825-7baa-4ce5-a492-8b364e876c99 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:01.065059 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fdb96825-7baa-4ce5-a492-8b364e876c99 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:01.066545 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fdb96825-7baa-4ce5-a492-8b364e876c99 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:01.068556 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fdb96825-7baa-4ce5-a492-8b364e876c99 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:01.072729 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fdb96825-7baa-4ce5-a492-8b364e876c99 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:01.074532 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fdb96825-7baa-4ce5-a492-8b364e876c99 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:01.075048 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-54feb216-a472-46b0-b2f7-d8dc7cea2ff4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Flavor limits 0:0:0 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 04:36:01.075524 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-54feb216-a472-46b0-b2f7-d8dc7cea2ff4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Image limits 0:0:0 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 04:36:01.076034 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-54feb216-a472-46b0-b2f7-d8dc7cea2ff4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Flavor pref 0:0:0 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 04:36:01.077027 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-54feb216-a472-46b0-b2f7-d8dc7cea2ff4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Image pref 0:0:0 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 04:36:01.077552 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-54feb216-a472-46b0-b2f7-d8dc7cea2ff4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 04:36:01.111653 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-54feb216-a472-46b0-b2f7-d8dc7cea2ff4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:01.112162 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-54feb216-a472-46b0-b2f7-d8dc7cea2ff4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:01.112605 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-54feb216-a472-46b0-b2f7-d8dc7cea2ff4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:01.127079 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-54feb216-a472-46b0-b2f7-d8dc7cea2ff4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:01.128819 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-54feb216-a472-46b0-b2f7-d8dc7cea2ff4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:01.129862 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-54feb216-a472-46b0-b2f7-d8dc7cea2ff4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:01.228316 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.quota [None req-54feb216-a472-46b0-b2f7-d8dc7cea2ff4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Getting quotas for project f6f23cf0323f48069e21acf059cbd1f0. Resources: {'instances', 'ram', 'cores'} {{(pid=127141) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 04:36:01.241712 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.quota [None req-54feb216-a472-46b0-b2f7-d8dc7cea2ff4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Getting quotas for user 2666d4774776498bbdbce539296e76a9 and project f6f23cf0323f48069e21acf059cbd1f0. Resources: {'instances', 'ram', 'cores'} {{(pid=127141) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 04:36:01.284453 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-54feb216-a472-46b0-b2f7-d8dc7cea2ff4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Going to run 1 instances... {{(pid=127141) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 04:36:01.302635 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-54feb216-a472-46b0-b2f7-d8dc7cea2ff4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5cfdbb2-d0ce-4736-b311-1a3c155844e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127141) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 04:36:01.474743 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-54feb216-a472-46b0-b2f7-d8dc7cea2ff4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.399742 Sep 25 04:36:01.493895 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 3/7] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 25 04:35:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 2420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 04:36:01.506473 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-9f1f3cdf-5467-4614-b81d-1bd3627b62e9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:01.511993 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-fdb96825-7baa-4ce5-a492-8b364e876c99 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:01.531540 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-9f1f3cdf-5467-4614-b81d-1bd3627b62e9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:01.582409 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-fdb96825-7baa-4ce5-a492-8b364e876c99 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1210 microversion: 2.1 time: 0.563621 Sep 25 04:36:01.591986 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 5/8] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:01 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1210 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:02.269704 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-9f1f3cdf-5467-4614-b81d-1bd3627b62e9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:02.277404 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-9f1f3cdf-5467-4614-b81d-1bd3627b62e9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1222 microversion: 2.1 time: 0.782053 Sep 25 04:36:02.277977 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 4/9] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:01 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1222 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:02.614349 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-84ec0117-1707-440f-8293-a7ea49d3c06c tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:02.614975 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-84ec0117-1707-440f-8293-a7ea49d3c06c tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:02.624756 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-84ec0117-1707-440f-8293-a7ea49d3c06c tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:02.627041 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-84ec0117-1707-440f-8293-a7ea49d3c06c tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:02.628414 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-84ec0117-1707-440f-8293-a7ea49d3c06c tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:02.633920 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-84ec0117-1707-440f-8293-a7ea49d3c06c tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:02.634666 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-84ec0117-1707-440f-8293-a7ea49d3c06c tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:02.641294 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-84ec0117-1707-440f-8293-a7ea49d3c06c tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:02.923757 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-84ec0117-1707-440f-8293-a7ea49d3c06c tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:02.943082 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-84ec0117-1707-440f-8293-a7ea49d3c06c tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1266 microversion: 2.1 time: 0.333997 Sep 25 04:36:02.946466 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 6/10] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:02 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1266 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:03.311088 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-92bc38cc-1b44-495b-a234-676d17a82341 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:03.311711 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-92bc38cc-1b44-495b-a234-676d17a82341 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:03.345983 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-92bc38cc-1b44-495b-a234-676d17a82341 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:03.346677 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-92bc38cc-1b44-495b-a234-676d17a82341 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:03.347344 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-92bc38cc-1b44-495b-a234-676d17a82341 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:03.348003 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-92bc38cc-1b44-495b-a234-676d17a82341 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:03.348465 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-92bc38cc-1b44-495b-a234-676d17a82341 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:03.358145 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-92bc38cc-1b44-495b-a234-676d17a82341 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:03.387310 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-db43e7d1-5767-4352-8daf-a18888aebabd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Action: 'create', calling method: .version_select at 0x7f4d3f213e50>, body: {"keypair": {"name": "tempest-keypair-1452435516", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfS8UX7iEfgkXgPMqHrFJhqTzSVa37NPi61RdALGOAfmcUMzKrjQKVaCM9m2msO/wF3+kBnBfiaHcf1+NrHilqAZwHtFVHc0XosylTjF5pF9+EKgEx+VqHMcRxd4+14zg=="}} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:36:03.407155 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.quota [None req-db43e7d1-5767-4352-8daf-a18888aebabd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Getting quotas for project a2ac515b97884375b3e85c6e54de81bc. Resources: {'key_pairs'} {{(pid=127142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 04:36:03.412324 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.quota [None req-db43e7d1-5767-4352-8daf-a18888aebabd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Getting quotas for user e7354aa144df4ad69cd7d12f11b1d8a5 and project a2ac515b97884375b3e85c6e54de81bc. Resources: {'key_pairs'} {{(pid=127142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 04:36:03.449288 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-db43e7d1-5767-4352-8daf-a18888aebabd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.142073 Sep 25 04:36:03.451666 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 7/11] 10.222.0.25 () {62 vars in 1200 bytes} [Sun Sep 25 04:36:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 145 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 25 04:36:03.686324 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-92bc38cc-1b44-495b-a234-676d17a82341 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:03.716184 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-92bc38cc-1b44-495b-a234-676d17a82341 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1218 microversion: 2.1 time: 0.413035 Sep 25 04:36:03.717326 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 5/12] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:03 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1218 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:03.969605 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-ff14e1a0-047f-47f0-9ac8-19e6563dc73c tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:03.972778 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-ff14e1a0-047f-47f0-9ac8-19e6563dc73c tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:03.998990 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ff14e1a0-047f-47f0-9ac8-19e6563dc73c tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:04.003634 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ff14e1a0-047f-47f0-9ac8-19e6563dc73c tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:04.004475 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ff14e1a0-047f-47f0-9ac8-19e6563dc73c tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:04.007932 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ff14e1a0-047f-47f0-9ac8-19e6563dc73c tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:04.008694 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ff14e1a0-047f-47f0-9ac8-19e6563dc73c tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:04.022927 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ff14e1a0-047f-47f0-9ac8-19e6563dc73c tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:04.569725 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-ff14e1a0-047f-47f0-9ac8-19e6563dc73c tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:04.600485 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-ff14e1a0-047f-47f0-9ac8-19e6563dc73c tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1272 microversion: 2.1 time: 0.636391 Sep 25 04:36:04.608864 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 8/13] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:03 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1272 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:04.744918 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-6150f341-2bed-4a55-9e7a-df1dc84531e6 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:04.745798 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-6150f341-2bed-4a55-9e7a-df1dc84531e6 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:04.765278 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6150f341-2bed-4a55-9e7a-df1dc84531e6 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:04.797932 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6150f341-2bed-4a55-9e7a-df1dc84531e6 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:04.803916 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6150f341-2bed-4a55-9e7a-df1dc84531e6 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:04.808063 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6150f341-2bed-4a55-9e7a-df1dc84531e6 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:04.816582 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6150f341-2bed-4a55-9e7a-df1dc84531e6 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:04.824279 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6150f341-2bed-4a55-9e7a-df1dc84531e6 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:05.378033 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-6150f341-2bed-4a55-9e7a-df1dc84531e6 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:05.390575 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-6150f341-2bed-4a55-9e7a-df1dc84531e6 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1280 microversion: 2.1 time: 0.650652 Sep 25 04:36:05.391203 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 6/14] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:04 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1280 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:05.637102 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-f393f91f-3d3c-4c99-a869-884ccd165070 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:05.637828 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-f393f91f-3d3c-4c99-a869-884ccd165070 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:05.659240 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f393f91f-3d3c-4c99-a869-884ccd165070 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:05.664720 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f393f91f-3d3c-4c99-a869-884ccd165070 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:05.666126 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f393f91f-3d3c-4c99-a869-884ccd165070 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:05.668968 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f393f91f-3d3c-4c99-a869-884ccd165070 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:05.673283 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f393f91f-3d3c-4c99-a869-884ccd165070 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:05.677752 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f393f91f-3d3c-4c99-a869-884ccd165070 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:06.050738 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-f393f91f-3d3c-4c99-a869-884ccd165070 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:06.071354 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-f393f91f-3d3c-4c99-a869-884ccd165070 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1272 microversion: 2.1 time: 0.435404 Sep 25 04:36:06.075385 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 9/15] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:05 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1272 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:06.426552 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-d531d699-9deb-4541-a3a4-5eb382094ae5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:06.427372 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-d531d699-9deb-4541-a3a4-5eb382094ae5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:06.441393 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d531d699-9deb-4541-a3a4-5eb382094ae5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:06.445371 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d531d699-9deb-4541-a3a4-5eb382094ae5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:06.446178 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d531d699-9deb-4541-a3a4-5eb382094ae5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:06.448779 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d531d699-9deb-4541-a3a4-5eb382094ae5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:06.449991 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d531d699-9deb-4541-a3a4-5eb382094ae5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:06.451058 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d531d699-9deb-4541-a3a4-5eb382094ae5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:07.059026 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-d531d699-9deb-4541-a3a4-5eb382094ae5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:07.089493 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-d531d699-9deb-4541-a3a4-5eb382094ae5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1280 microversion: 2.1 time: 0.666830 Sep 25 04:36:07.094378 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 7/16] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:06 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1280 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:07.104288 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-7a12b096-a271-4765-b975-05d06d7819f1 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:07.109680 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-7a12b096-a271-4765-b975-05d06d7819f1 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:07.120853 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7a12b096-a271-4765-b975-05d06d7819f1 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:07.121363 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7a12b096-a271-4765-b975-05d06d7819f1 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:07.121809 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7a12b096-a271-4765-b975-05d06d7819f1 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:07.122723 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7a12b096-a271-4765-b975-05d06d7819f1 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:07.128631 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7a12b096-a271-4765-b975-05d06d7819f1 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:07.131172 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7a12b096-a271-4765-b975-05d06d7819f1 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:07.374376 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-7a12b096-a271-4765-b975-05d06d7819f1 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:07.388327 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-7a12b096-a271-4765-b975-05d06d7819f1 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1272 microversion: 2.1 time: 0.296620 Sep 25 04:36:07.389594 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 10/17] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:07 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1272 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:08.122427 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-378e9f4e-cdc5-4548-a087-e1a318b147c7 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:08.125126 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-378e9f4e-cdc5-4548-a087-e1a318b147c7 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:08.137660 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-378e9f4e-cdc5-4548-a087-e1a318b147c7 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:08.141580 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-378e9f4e-cdc5-4548-a087-e1a318b147c7 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:08.142577 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-378e9f4e-cdc5-4548-a087-e1a318b147c7 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:08.151678 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-378e9f4e-cdc5-4548-a087-e1a318b147c7 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:08.153323 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-378e9f4e-cdc5-4548-a087-e1a318b147c7 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:08.160428 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-378e9f4e-cdc5-4548-a087-e1a318b147c7 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:08.422294 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-2e96b814-ccbc-4ef2-88c5-291ddfc07a64 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:08.425582 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-2e96b814-ccbc-4ef2-88c5-291ddfc07a64 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:08.440387 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell0:SELECT=2 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:08.464571 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2e96b814-ccbc-4ef2-88c5-291ddfc07a64 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:08.476289 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2e96b814-ccbc-4ef2-88c5-291ddfc07a64 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:08.478357 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2e96b814-ccbc-4ef2-88c5-291ddfc07a64 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:08.481905 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2e96b814-ccbc-4ef2-88c5-291ddfc07a64 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:08.485241 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2e96b814-ccbc-4ef2-88c5-291ddfc07a64 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:08.488818 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2e96b814-ccbc-4ef2-88c5-291ddfc07a64 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:08.986456 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-378e9f4e-cdc5-4548-a087-e1a318b147c7 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:08.999858 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-378e9f4e-cdc5-4548-a087-e1a318b147c7 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1280 microversion: 2.1 time: 0.881260 Sep 25 04:36:09.017951 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 8/18] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:08 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1280 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:09.844611 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-2e96b814-ccbc-4ef2-88c5-291ddfc07a64 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:09.864629 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-2e96b814-ccbc-4ef2-88c5-291ddfc07a64 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1314 microversion: 2.1 time: 1.452755 Sep 25 04:36:09.876679 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 11/19] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:08 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1314 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:10.042266 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-47bc4af5-2f59-4f1e-89e7-2faa68b8b31a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:10.044137 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-47bc4af5-2f59-4f1e-89e7-2faa68b8b31a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:10.071850 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-47bc4af5-2f59-4f1e-89e7-2faa68b8b31a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:10.072615 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-47bc4af5-2f59-4f1e-89e7-2faa68b8b31a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:10.080347 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-47bc4af5-2f59-4f1e-89e7-2faa68b8b31a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:10.084790 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-47bc4af5-2f59-4f1e-89e7-2faa68b8b31a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:10.087909 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-47bc4af5-2f59-4f1e-89e7-2faa68b8b31a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:10.090382 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-47bc4af5-2f59-4f1e-89e7-2faa68b8b31a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:10.572683 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-47bc4af5-2f59-4f1e-89e7-2faa68b8b31a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:10.591719 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-47bc4af5-2f59-4f1e-89e7-2faa68b8b31a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1280 microversion: 2.1 time: 0.556865 Sep 25 04:36:10.635436 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 9/20] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:10 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1280 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:10.895680 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-df03f516-00ca-4ba7-856d-db8a53237c92 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:10.897692 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-df03f516-00ca-4ba7-856d-db8a53237c92 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:10.914660 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-df03f516-00ca-4ba7-856d-db8a53237c92 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:10.917555 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-df03f516-00ca-4ba7-856d-db8a53237c92 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:10.918227 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-df03f516-00ca-4ba7-856d-db8a53237c92 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:10.920622 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-df03f516-00ca-4ba7-856d-db8a53237c92 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:10.923351 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-df03f516-00ca-4ba7-856d-db8a53237c92 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:10.924631 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-df03f516-00ca-4ba7-856d-db8a53237c92 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:11.361666 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell0:SELECT=4 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:11.950432 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-bb98f4a6-a75f-4e23-a0d1-ae19661fca18 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Action: 'create', calling method: .version_select at 0x7f4d3f234ee0>, body: {"keypair": {"name": "tempest-keypair-2070930957", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdkOJ0ah8W8TKombPyK2zKmTr5WgKQre3JNO4lVRrFbkcZcjrKPDK5tfZxrZDfvObb34LeJSYTlvkT9+qU2SgTTiyqnDqCLPZVPx6N9xyxZs+nnVH9RgjKxrGOCh3oKTg=="}} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:36:12.071840 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.quota [None req-bb98f4a6-a75f-4e23-a0d1-ae19661fca18 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Getting quotas for project e1108f4c9da246cb9b4b9f89833ceeda. Resources: {'key_pairs'} {{(pid=127141) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 04:36:12.094695 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.quota [None req-bb98f4a6-a75f-4e23-a0d1-ae19661fca18 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Getting quotas for user 16281c79f73e4063b52066966c393148 and project e1108f4c9da246cb9b4b9f89833ceeda. Resources: {'key_pairs'} {{(pid=127141) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 04:36:12.187783 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-bb98f4a6-a75f-4e23-a0d1-ae19661fca18 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.837026 Sep 25 04:36:12.192833 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 10/21] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 25 04:36:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 04:36:12.206492 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-ac6c115c-7853-443d-a78f-477b44122e2f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:12.207724 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-ac6c115c-7853-443d-a78f-477b44122e2f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:12.216896 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ac6c115c-7853-443d-a78f-477b44122e2f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:12.218038 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ac6c115c-7853-443d-a78f-477b44122e2f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:12.218808 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ac6c115c-7853-443d-a78f-477b44122e2f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:12.223720 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ac6c115c-7853-443d-a78f-477b44122e2f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:12.224426 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ac6c115c-7853-443d-a78f-477b44122e2f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:12.225244 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ac6c115c-7853-443d-a78f-477b44122e2f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:12.930987 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-ac6c115c-7853-443d-a78f-477b44122e2f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:12.997933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-ac6c115c-7853-443d-a78f-477b44122e2f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1280 microversion: 2.1 time: 0.800285 Sep 25 04:36:13.001279 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 11/22] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:12 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1280 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:13.385192 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-df03f516-00ca-4ba7-856d-db8a53237c92 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:13.411669 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-df03f516-00ca-4ba7-856d-db8a53237c92 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1314 microversion: 2.1 time: 2.520230 Sep 25 04:36:13.420560 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 12/23] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:10 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1314 bytes in 2533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:14.024525 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-01ed4ccb-2279-472e-913e-744dfe3c8705 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:14.026189 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-01ed4ccb-2279-472e-913e-744dfe3c8705 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:14.040878 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-01ed4ccb-2279-472e-913e-744dfe3c8705 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:14.062647 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-01ed4ccb-2279-472e-913e-744dfe3c8705 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:14.064161 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-01ed4ccb-2279-472e-913e-744dfe3c8705 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:14.066002 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-01ed4ccb-2279-472e-913e-744dfe3c8705 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:14.067518 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-01ed4ccb-2279-472e-913e-744dfe3c8705 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:14.068412 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-01ed4ccb-2279-472e-913e-744dfe3c8705 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:14.357784 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-0ecac3c5-4f3f-4c4e-ad9d-05ed1514108c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1092846673", "imageRef": "e5cfdbb2-d0ce-4736-b311-1a3c155844e9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4d931b43-9f4d-4494-b9d1-d242cc1f110c"}], "security_groups": [{"name": "tempest-securitygroup--4277256"}], "key_name": "tempest-keypair-38398811", "user_data": "}} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:36:14.384255 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell0:SELECT=18 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:14.806905 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.network.neutron [None req-0ecac3c5-4f3f-4c4e-ad9d-05ed1514108c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] validate_networks() for [('4d931b43-9f4d-4494-b9d1-d242cc1f110c', None, None, None, None, None)] {{(pid=127142) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 04:36:15.676651 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-01ed4ccb-2279-472e-913e-744dfe3c8705 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:15.734741 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-01ed4ccb-2279-472e-913e-744dfe3c8705 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1322 microversion: 2.1 time: 1.710928 Sep 25 04:36:15.736710 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 12/24] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:14 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1322 bytes in 1718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:15.759684 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-3e80f72a-ee89-4a2b-b13e-d741c2db7fe7 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:15.767005 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-3e80f72a-ee89-4a2b-b13e-d741c2db7fe7 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:15.827728 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3e80f72a-ee89-4a2b-b13e-d741c2db7fe7 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:15.830593 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3e80f72a-ee89-4a2b-b13e-d741c2db7fe7 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:15.832287 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3e80f72a-ee89-4a2b-b13e-d741c2db7fe7 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:15.834975 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3e80f72a-ee89-4a2b-b13e-d741c2db7fe7 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:15.839176 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3e80f72a-ee89-4a2b-b13e-d741c2db7fe7 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:15.850584 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3e80f72a-ee89-4a2b-b13e-d741c2db7fe7 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:17.714627 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-3e80f72a-ee89-4a2b-b13e-d741c2db7fe7 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:17.726109 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-3e80f72a-ee89-4a2b-b13e-d741c2db7fe7 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1314 microversion: 2.1 time: 1.983732 Sep 25 04:36:17.733459 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 13/25] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:15 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1314 bytes in 1992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:17.745360 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-5641bee9-4a00-4224-a653-85697815178a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:17.748939 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-5641bee9-4a00-4224-a653-85697815178a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:17.768937 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5641bee9-4a00-4224-a653-85697815178a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:17.772580 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5641bee9-4a00-4224-a653-85697815178a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:17.774731 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5641bee9-4a00-4224-a653-85697815178a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:17.776838 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5641bee9-4a00-4224-a653-85697815178a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:17.777576 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5641bee9-4a00-4224-a653-85697815178a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:17.778491 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5641bee9-4a00-4224-a653-85697815178a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:18.534472 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-5641bee9-4a00-4224-a653-85697815178a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:18.546647 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-0ecac3c5-4f3f-4c4e-ad9d-05ed1514108c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Flavor limits 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 04:36:18.547099 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-0ecac3c5-4f3f-4c4e-ad9d-05ed1514108c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Image limits 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 04:36:18.547523 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-0ecac3c5-4f3f-4c4e-ad9d-05ed1514108c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Flavor pref 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 04:36:18.547942 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-0ecac3c5-4f3f-4c4e-ad9d-05ed1514108c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Image pref 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 04:36:18.548360 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-0ecac3c5-4f3f-4c4e-ad9d-05ed1514108c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 04:36:18.564808 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-5641bee9-4a00-4224-a653-85697815178a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1322 microversion: 2.1 time: 0.826654 Sep 25 04:36:18.568924 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 14/26] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:17 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1322 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:18.569927 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0ecac3c5-4f3f-4c4e-ad9d-05ed1514108c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:18.570426 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0ecac3c5-4f3f-4c4e-ad9d-05ed1514108c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:18.570891 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0ecac3c5-4f3f-4c4e-ad9d-05ed1514108c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:18.571607 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0ecac3c5-4f3f-4c4e-ad9d-05ed1514108c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:18.572072 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0ecac3c5-4f3f-4c4e-ad9d-05ed1514108c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:18.572544 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0ecac3c5-4f3f-4c4e-ad9d-05ed1514108c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:18.625948 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.quota [None req-0ecac3c5-4f3f-4c4e-ad9d-05ed1514108c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Getting quotas for project 5ead2221f7f54d6cbea9fc086a089342. Resources: {'instances', 'ram', 'cores'} {{(pid=127142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 04:36:18.639262 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.quota [None req-0ecac3c5-4f3f-4c4e-ad9d-05ed1514108c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Getting quotas for user c50ba6f9a164463eae9a248936e7bf80 and project 5ead2221f7f54d6cbea9fc086a089342. Resources: {'instances', 'ram', 'cores'} {{(pid=127142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 04:36:18.678509 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-0ecac3c5-4f3f-4c4e-ad9d-05ed1514108c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Going to run 1 instances... {{(pid=127142) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 04:36:18.680787 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-0ecac3c5-4f3f-4c4e-ad9d-05ed1514108c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5cfdbb2-d0ce-4736-b311-1a3c155844e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 04:36:18.857823 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-0ecac3c5-4f3f-4c4e-ad9d-05ed1514108c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 4.505882 Sep 25 04:36:18.873733 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 13/27] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 25 04:36:14 2022] POST /compute/v2.1/servers => generated 399 bytes in 4520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 04:36:19.094268 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [req-49e28e10-0022-4c58-aac1-12cda2dc0037 req-4cee1d6f-bd65-49fc-ab7a-186406d000e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4dfff9d-4fc4-4f36-aab0-786607ac2cd2", "tag": "f2950532-6a9f-448f-9801-43583bcb904e"}]} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:36:19.131859 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-49e28e10-0022-4c58-aac1-12cda2dc0037 req-4cee1d6f-bd65-49fc-ab7a-186406d000e6 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:19.133607 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-49e28e10-0022-4c58-aac1-12cda2dc0037 req-4cee1d6f-bd65-49fc-ab7a-186406d000e6 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:19.134152 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-49e28e10-0022-4c58-aac1-12cda2dc0037 req-4cee1d6f-bd65-49fc-ab7a-186406d000e6 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:19.138748 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-7d1bc34b-8a0b-4ca4-bb4a-0e88f0d3dc0a req-83a497d0-742c-4908-85ae-4b0aaa8dbdb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a4fe760-3afd-42e5-9909-86ca268c9b96", "tag": "320631df-79bd-4e26-a748-a2b0a3daee05"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:36:19.160270 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.compute.server_external_events [req-49e28e10-0022-4c58-aac1-12cda2dc0037 req-4cee1d6f-bd65-49fc-ab7a-186406d000e6 service nova] Creating event network-changed:f2950532-6a9f-448f-9801-43583bcb904e for instance f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 on hv-cinder-85535 Sep 25 04:36:19.161238 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-49e28e10-0022-4c58-aac1-12cda2dc0037 req-4cee1d6f-bd65-49fc-ab7a-186406d000e6 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127141) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 25 04:36:19.162082 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-49e28e10-0022-4c58-aac1-12cda2dc0037 req-4cee1d6f-bd65-49fc-ab7a-186406d000e6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127141) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 25 04:36:19.164431 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-eb741dfd-e9b7-45d9-828e-7215145019dd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:19.168006 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-eb741dfd-e9b7-45d9-828e-7215145019dd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:19.168704 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-eb741dfd-e9b7-45d9-828e-7215145019dd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:19.170077 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-eb741dfd-e9b7-45d9-828e-7215145019dd None None] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:19.171048 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-eb741dfd-e9b7-45d9-828e-7215145019dd None None] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:19.172487 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-eb741dfd-e9b7-45d9-828e-7215145019dd None None] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:19.178895 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-7d1bc34b-8a0b-4ca4-bb4a-0e88f0d3dc0a req-83a497d0-742c-4908-85ae-4b0aaa8dbdb8 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:19.179403 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-7d1bc34b-8a0b-4ca4-bb4a-0e88f0d3dc0a req-83a497d0-742c-4908-85ae-4b0aaa8dbdb8 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:19.179848 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-7d1bc34b-8a0b-4ca4-bb4a-0e88f0d3dc0a req-83a497d0-742c-4908-85ae-4b0aaa8dbdb8 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:19.198362 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.compute.rpcapi [None req-eb741dfd-e9b7-45d9-828e-7215145019dd None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 25 04:36:19.200070 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-eb741dfd-e9b7-45d9-828e-7215145019dd None None] Releasing lock "compute-rpcapi-router" {{(pid=127141) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 25 04:36:19.236087 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-eb741dfd-e9b7-45d9-828e-7215145019dd None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.665100 Sep 25 04:36:19.242717 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 15/28] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:36:19.245321 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-7d1bc34b-8a0b-4ca4-bb4a-0e88f0d3dc0a req-83a497d0-742c-4908-85ae-4b0aaa8dbdb8 service nova] Creating event network-changed:320631df-79bd-4e26-a748-a2b0a3daee05 for instance 8a4fe760-3afd-42e5-9909-86ca268c9b96 on hv-cinder-85535 Sep 25 04:36:19.246076 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-7d1bc34b-8a0b-4ca4-bb4a-0e88f0d3dc0a req-83a497d0-742c-4908-85ae-4b0aaa8dbdb8 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127142) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 25 04:36:19.246623 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-7d1bc34b-8a0b-4ca4-bb4a-0e88f0d3dc0a req-83a497d0-742c-4908-85ae-4b0aaa8dbdb8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127142) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 25 04:36:19.248805 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ed3eee6d-d1b1-4fac-9fec-9f4ab4382a20 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:19.249461 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ed3eee6d-d1b1-4fac-9fec-9f4ab4382a20 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:19.250197 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ed3eee6d-d1b1-4fac-9fec-9f4ab4382a20 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:19.251288 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ed3eee6d-d1b1-4fac-9fec-9f4ab4382a20 None None] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:19.251917 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ed3eee6d-d1b1-4fac-9fec-9f4ab4382a20 None None] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:19.252518 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ed3eee6d-d1b1-4fac-9fec-9f4ab4382a20 None None] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:19.254504 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-f918a9d2-60d9-49f1-9472-93e1659a77d7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1826979310", "imageRef": "e5cfdbb2-d0ce-4736-b311-1a3c155844e9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "10349c1a-2a69-4296-a276-3606a4c13086"}], "security_groups": [{"name": "tempest-securitygroup--1878569046"}], "key_name": "tempest-keypair-2070930957", "user_data": "}} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:36:19.263949 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.compute.rpcapi [None req-ed3eee6d-d1b1-4fac-9fec-9f4ab4382a20 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 25 04:36:19.265008 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ed3eee6d-d1b1-4fac-9fec-9f4ab4382a20 None None] Releasing lock "compute-rpcapi-router" {{(pid=127142) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 25 04:36:19.284229 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-ed3eee6d-d1b1-4fac-9fec-9f4ab4382a20 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.407500 Sep 25 04:36:19.285178 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 14/29] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:36:19.294606 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-34c4d71d-c758-4bf8-8d6b-73f8598ee97e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:19.295636 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-34c4d71d-c758-4bf8-8d6b-73f8598ee97e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:19.306649 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-34c4d71d-c758-4bf8-8d6b-73f8598ee97e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:19.307187 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-34c4d71d-c758-4bf8-8d6b-73f8598ee97e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:19.307632 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-34c4d71d-c758-4bf8-8d6b-73f8598ee97e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:19.308543 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-34c4d71d-c758-4bf8-8d6b-73f8598ee97e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:19.309232 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-34c4d71d-c758-4bf8-8d6b-73f8598ee97e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:19.309914 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-34c4d71d-c758-4bf8-8d6b-73f8598ee97e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:19.486347 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.network.neutron [None req-f918a9d2-60d9-49f1-9472-93e1659a77d7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] validate_networks() for [('10349c1a-2a69-4296-a276-3606a4c13086', None, None, None, None, None)] {{(pid=127141) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 04:36:19.655417 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-34c4d71d-c758-4bf8-8d6b-73f8598ee97e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:19.665227 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-34c4d71d-c758-4bf8-8d6b-73f8598ee97e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1314 microversion: 2.1 time: 0.377424 Sep 25 04:36:19.665916 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 15/30] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:19 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:19.675011 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-1ff94e4c-a2ed-4517-99ef-12300df41dd1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:19.677392 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-1ff94e4c-a2ed-4517-99ef-12300df41dd1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:19.690559 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1ff94e4c-a2ed-4517-99ef-12300df41dd1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:19.691062 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1ff94e4c-a2ed-4517-99ef-12300df41dd1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:19.691696 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1ff94e4c-a2ed-4517-99ef-12300df41dd1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:19.692400 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1ff94e4c-a2ed-4517-99ef-12300df41dd1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:19.692933 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1ff94e4c-a2ed-4517-99ef-12300df41dd1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:19.693366 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1ff94e4c-a2ed-4517-99ef-12300df41dd1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:19.799139 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-1ff94e4c-a2ed-4517-99ef-12300df41dd1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:19.808462 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-1ff94e4c-a2ed-4517-99ef-12300df41dd1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1244 microversion: 2.1 time: 0.137137 Sep 25 04:36:19.809624 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 16/31] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:19 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1244 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:19.816263 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-9a7668ba-e7f8-4ea6-8f3e-1d6bf420dc0c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1226973070", "imageRef": "e5cfdbb2-d0ce-4736-b311-1a3c155844e9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "442ef807-682d-48e2-b151-5ae7fd6da3f5"}], "security_groups": [{"name": "tempest-securitygroup--383580722"}], "key_name": "tempest-keypair-1452435516", "user_data": "}} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:36:20.028979 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.network.neutron [None req-9a7668ba-e7f8-4ea6-8f3e-1d6bf420dc0c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] validate_networks() for [('442ef807-682d-48e2-b151-5ae7fd6da3f5', None, None, None, None, None)] {{(pid=127142) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 04:36:20.250209 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-f918a9d2-60d9-49f1-9472-93e1659a77d7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Flavor limits 0:0:0 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 04:36:20.251397 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-f918a9d2-60d9-49f1-9472-93e1659a77d7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Image limits 0:0:0 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 04:36:20.252091 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-f918a9d2-60d9-49f1-9472-93e1659a77d7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Flavor pref 0:0:0 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 04:36:20.252756 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-f918a9d2-60d9-49f1-9472-93e1659a77d7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Image pref 0:0:0 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 04:36:20.253317 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-f918a9d2-60d9-49f1-9472-93e1659a77d7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 04:36:20.265122 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f918a9d2-60d9-49f1-9472-93e1659a77d7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:20.265857 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f918a9d2-60d9-49f1-9472-93e1659a77d7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:20.266434 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f918a9d2-60d9-49f1-9472-93e1659a77d7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:20.267541 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f918a9d2-60d9-49f1-9472-93e1659a77d7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:20.268178 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f918a9d2-60d9-49f1-9472-93e1659a77d7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:20.268987 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f918a9d2-60d9-49f1-9472-93e1659a77d7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:20.306813 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.quota [None req-f918a9d2-60d9-49f1-9472-93e1659a77d7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Getting quotas for project e1108f4c9da246cb9b4b9f89833ceeda. Resources: {'instances', 'ram', 'cores'} {{(pid=127141) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 04:36:20.313044 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.quota [None req-f918a9d2-60d9-49f1-9472-93e1659a77d7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Getting quotas for user 16281c79f73e4063b52066966c393148 and project e1108f4c9da246cb9b4b9f89833ceeda. Resources: {'instances', 'ram', 'cores'} {{(pid=127141) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 04:36:20.339982 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-f918a9d2-60d9-49f1-9472-93e1659a77d7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Going to run 1 instances... {{(pid=127141) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 04:36:20.346217 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-f918a9d2-60d9-49f1-9472-93e1659a77d7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5cfdbb2-d0ce-4736-b311-1a3c155844e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127141) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 04:36:20.491080 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-f918a9d2-60d9-49f1-9472-93e1659a77d7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.246609 Sep 25 04:36:20.492154 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 16/32] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 25 04:36:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 1249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 04:36:20.499708 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-d4e226d4-e781-4def-b684-f523fd0e9a31 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:20.500532 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-d4e226d4-e781-4def-b684-f523fd0e9a31 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:20.508704 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d4e226d4-e781-4def-b684-f523fd0e9a31 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:20.509407 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d4e226d4-e781-4def-b684-f523fd0e9a31 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:20.510086 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d4e226d4-e781-4def-b684-f523fd0e9a31 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:20.511075 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d4e226d4-e781-4def-b684-f523fd0e9a31 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:20.511818 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d4e226d4-e781-4def-b684-f523fd0e9a31 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:20.512432 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d4e226d4-e781-4def-b684-f523fd0e9a31 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:20.917304 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-d4e226d4-e781-4def-b684-f523fd0e9a31 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:20.933713 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-d4e226d4-e781-4def-b684-f523fd0e9a31 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1322 microversion: 2.1 time: 0.439310 Sep 25 04:36:20.934995 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 17/33] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:20 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1322 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:20.940108 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-452d5761-42c7-4a9a-b0e7-6236d8af1445 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:20.942863 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-452d5761-42c7-4a9a-b0e7-6236d8af1445 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:21.100921 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-452d5761-42c7-4a9a-b0e7-6236d8af1445 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:21.104844 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-9a7668ba-e7f8-4ea6-8f3e-1d6bf420dc0c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Flavor limits 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 04:36:21.106573 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-9a7668ba-e7f8-4ea6-8f3e-1d6bf420dc0c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Image limits 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 04:36:21.108945 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-9a7668ba-e7f8-4ea6-8f3e-1d6bf420dc0c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Flavor pref 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 04:36:21.109241 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-452d5761-42c7-4a9a-b0e7-6236d8af1445 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1238 microversion: 2.1 time: 0.173187 Sep 25 04:36:21.109834 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 18/34] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:20 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1238 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:21.110273 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-9a7668ba-e7f8-4ea6-8f3e-1d6bf420dc0c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Image pref 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 04:36:21.111036 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-9a7668ba-e7f8-4ea6-8f3e-1d6bf420dc0c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 04:36:21.117962 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-31f54940-f054-42ab-a1b9-8a3838c97ccb tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:21.118567 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-31f54940-f054-42ab-a1b9-8a3838c97ccb tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:21.128826 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9a7668ba-e7f8-4ea6-8f3e-1d6bf420dc0c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:21.129331 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9a7668ba-e7f8-4ea6-8f3e-1d6bf420dc0c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:21.129779 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9a7668ba-e7f8-4ea6-8f3e-1d6bf420dc0c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:21.130505 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9a7668ba-e7f8-4ea6-8f3e-1d6bf420dc0c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:21.130960 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9a7668ba-e7f8-4ea6-8f3e-1d6bf420dc0c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:21.131409 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9a7668ba-e7f8-4ea6-8f3e-1d6bf420dc0c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:21.136515 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-31f54940-f054-42ab-a1b9-8a3838c97ccb tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:21.137045 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-31f54940-f054-42ab-a1b9-8a3838c97ccb tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:21.137649 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-31f54940-f054-42ab-a1b9-8a3838c97ccb tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:21.139195 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-31f54940-f054-42ab-a1b9-8a3838c97ccb tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:21.139957 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-31f54940-f054-42ab-a1b9-8a3838c97ccb tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:21.140551 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-31f54940-f054-42ab-a1b9-8a3838c97ccb tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:21.150294 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.quota [None req-9a7668ba-e7f8-4ea6-8f3e-1d6bf420dc0c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Getting quotas for project a2ac515b97884375b3e85c6e54de81bc. Resources: {'instances', 'ram', 'cores'} {{(pid=127142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 04:36:21.154732 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.quota [None req-9a7668ba-e7f8-4ea6-8f3e-1d6bf420dc0c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Getting quotas for user e7354aa144df4ad69cd7d12f11b1d8a5 and project a2ac515b97884375b3e85c6e54de81bc. Resources: {'instances', 'ram', 'cores'} {{(pid=127142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 04:36:21.167658 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:21.170361 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-9a7668ba-e7f8-4ea6-8f3e-1d6bf420dc0c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Going to run 1 instances... {{(pid=127142) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 04:36:21.172958 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-9a7668ba-e7f8-4ea6-8f3e-1d6bf420dc0c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5cfdbb2-d0ce-4736-b311-1a3c155844e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 04:36:21.254619 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-9a7668ba-e7f8-4ea6-8f3e-1d6bf420dc0c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.442780 Sep 25 04:36:21.262281 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 17/35] 10.222.0.25 () {62 vars in 1188 bytes} [Sun Sep 25 04:36:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 1451 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 25 04:36:21.269574 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-20477aef-98a5-4b25-b2cf-6a9509b7a68e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:21.270744 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-20477aef-98a5-4b25-b2cf-6a9509b7a68e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:21.280004 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-20477aef-98a5-4b25-b2cf-6a9509b7a68e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:21.280580 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-20477aef-98a5-4b25-b2cf-6a9509b7a68e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:21.281125 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-20477aef-98a5-4b25-b2cf-6a9509b7a68e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:21.281911 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-20477aef-98a5-4b25-b2cf-6a9509b7a68e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:21.282509 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-20477aef-98a5-4b25-b2cf-6a9509b7a68e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:21.283033 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-20477aef-98a5-4b25-b2cf-6a9509b7a68e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:21.361412 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-20477aef-98a5-4b25-b2cf-6a9509b7a68e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:21.369743 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-20477aef-98a5-4b25-b2cf-6a9509b7a68e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1244 microversion: 2.1 time: 0.106922 Sep 25 04:36:21.383072 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 18/36] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:21 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1244 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:21.384976 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-31f54940-f054-42ab-a1b9-8a3838c97ccb tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:21.392844 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-76f4fdf7-3af5-4374-81ce-de35bdf46233 req-89b7c9f3-49eb-4d63-bee0-497a74b363aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28c97cc6-73d6-4bf6-9d88-e93dad58e7dc", "tag": "3a4f0d9a-e61b-45f0-b1ce-b92f0048c739"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:36:21.395003 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-31f54940-f054-42ab-a1b9-8a3838c97ccb tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1314 microversion: 2.1 time: 0.281178 Sep 25 04:36:21.396006 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 19/37] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:21 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:21.401069 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-2407b889-19df-4265-b09f-ee973457fad2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:21.402051 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-2407b889-19df-4265-b09f-ee973457fad2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:21.407418 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-76f4fdf7-3af5-4374-81ce-de35bdf46233 req-89b7c9f3-49eb-4d63-bee0-497a74b363aa service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:21.408102 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-76f4fdf7-3af5-4374-81ce-de35bdf46233 req-89b7c9f3-49eb-4d63-bee0-497a74b363aa service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:21.408951 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-76f4fdf7-3af5-4374-81ce-de35bdf46233 req-89b7c9f3-49eb-4d63-bee0-497a74b363aa service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:21.410849 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:21.445137 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-76f4fdf7-3af5-4374-81ce-de35bdf46233 req-89b7c9f3-49eb-4d63-bee0-497a74b363aa service nova] Creating event network-changed:3a4f0d9a-e61b-45f0-b1ce-b92f0048c739 for instance 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc on hv-cinder-85535 Sep 25 04:36:21.451672 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-76f4fdf7-3af5-4374-81ce-de35bdf46233 req-89b7c9f3-49eb-4d63-bee0-497a74b363aa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065851 Sep 25 04:36:21.452903 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 19/38] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:36:21.470386 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-2407b889-19df-4265-b09f-ee973457fad2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:21.484734 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-2407b889-19df-4265-b09f-ee973457fad2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:21.486550 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-2407b889-19df-4265-b09f-ee973457fad2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:21.487704 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-2407b889-19df-4265-b09f-ee973457fad2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1282 microversion: 2.20 time: 0.090531 Sep 25 04:36:21.488261 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 20/39] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:36:21 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1282 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:36:21.961364 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-baa69a27-22b1-46d8-90f3-c4591e48a5bb tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:21.962071 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-baa69a27-22b1-46d8-90f3-c4591e48a5bb tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:21.968783 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-baa69a27-22b1-46d8-90f3-c4591e48a5bb tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:21.969293 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-baa69a27-22b1-46d8-90f3-c4591e48a5bb tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:21.969731 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-baa69a27-22b1-46d8-90f3-c4591e48a5bb tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:21.970427 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-baa69a27-22b1-46d8-90f3-c4591e48a5bb tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:21.970930 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-baa69a27-22b1-46d8-90f3-c4591e48a5bb tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:21.971379 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-baa69a27-22b1-46d8-90f3-c4591e48a5bb tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:22.121761 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-baa69a27-22b1-46d8-90f3-c4591e48a5bb tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:22.130666 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-baa69a27-22b1-46d8-90f3-c4591e48a5bb tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1322 microversion: 2.1 time: 0.173755 Sep 25 04:36:22.131254 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 20/40] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:21 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:22.134569 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-0eaee9b7-a08e-48c3-b931-3162c70b5190 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:22.135411 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-0eaee9b7-a08e-48c3-b931-3162c70b5190 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:22.142725 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0eaee9b7-a08e-48c3-b931-3162c70b5190 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:22.143444 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0eaee9b7-a08e-48c3-b931-3162c70b5190 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:22.143976 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0eaee9b7-a08e-48c3-b931-3162c70b5190 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:22.144821 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0eaee9b7-a08e-48c3-b931-3162c70b5190 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:22.145473 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0eaee9b7-a08e-48c3-b931-3162c70b5190 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:22.145968 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0eaee9b7-a08e-48c3-b931-3162c70b5190 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:22.224341 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-0eaee9b7-a08e-48c3-b931-3162c70b5190 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:22.241258 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-0eaee9b7-a08e-48c3-b931-3162c70b5190 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1242 microversion: 2.1 time: 0.110758 Sep 25 04:36:22.242265 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 21/41] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:22 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1242 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:36:22.395002 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-085784bf-84e8-406c-b112-fab9b26f41a1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:22.395883 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-085784bf-84e8-406c-b112-fab9b26f41a1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:22.407715 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-085784bf-84e8-406c-b112-fab9b26f41a1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:22.408219 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-085784bf-84e8-406c-b112-fab9b26f41a1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:22.408766 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-085784bf-84e8-406c-b112-fab9b26f41a1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:22.409740 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-085784bf-84e8-406c-b112-fab9b26f41a1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:22.411449 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-085784bf-84e8-406c-b112-fab9b26f41a1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:22.411886 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-085784bf-84e8-406c-b112-fab9b26f41a1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:22.423662 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-050fda9b-0167-47f7-af26-74573c06bef0 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:22.424938 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-050fda9b-0167-47f7-af26-74573c06bef0 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:22.432306 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-050fda9b-0167-47f7-af26-74573c06bef0 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:22.433043 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-050fda9b-0167-47f7-af26-74573c06bef0 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:22.433814 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-050fda9b-0167-47f7-af26-74573c06bef0 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:22.438613 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-050fda9b-0167-47f7-af26-74573c06bef0 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:22.439128 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-050fda9b-0167-47f7-af26-74573c06bef0 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:22.439765 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-050fda9b-0167-47f7-af26-74573c06bef0 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:22.813091 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-085784bf-84e8-406c-b112-fab9b26f41a1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:22.850658 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-085784bf-84e8-406c-b112-fab9b26f41a1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1236 microversion: 2.1 time: 0.451510 Sep 25 04:36:22.851404 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 21/42] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:22 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1236 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:22.865511 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-98261c9f-5c05-43c5-8f2e-a4c981d8f871 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:22.875753 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-98261c9f-5c05-43c5-8f2e-a4c981d8f871 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:22.895278 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-98261c9f-5c05-43c5-8f2e-a4c981d8f871 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:22.897754 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-98261c9f-5c05-43c5-8f2e-a4c981d8f871 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:22.898808 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-98261c9f-5c05-43c5-8f2e-a4c981d8f871 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:22.902873 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-98261c9f-5c05-43c5-8f2e-a4c981d8f871 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:22.903360 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-98261c9f-5c05-43c5-8f2e-a4c981d8f871 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:22.903861 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-98261c9f-5c05-43c5-8f2e-a4c981d8f871 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:23.035062 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-98261c9f-5c05-43c5-8f2e-a4c981d8f871 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:23.046276 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-98261c9f-5c05-43c5-8f2e-a4c981d8f871 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:23.048000 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-98261c9f-5c05-43c5-8f2e-a4c981d8f871 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:23.049277 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-98261c9f-5c05-43c5-8f2e-a4c981d8f871 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1278 microversion: 2.20 time: 0.196274 Sep 25 04:36:23.049876 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 22/43] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:36:22 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1278 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:36:23.086129 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-050fda9b-0167-47f7-af26-74573c06bef0 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:23.095128 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-050fda9b-0167-47f7-af26-74573c06bef0 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1314 microversion: 2.1 time: 0.679072 Sep 25 04:36:23.095885 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 22/44] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:22 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1314 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:36:23.154029 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-ceeacf6c-1406-48db-ad7c-ba1befdd2b79 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:23.154680 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-ceeacf6c-1406-48db-ad7c-ba1befdd2b79 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:23.160773 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ceeacf6c-1406-48db-ad7c-ba1befdd2b79 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:23.161457 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ceeacf6c-1406-48db-ad7c-ba1befdd2b79 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:23.161874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ceeacf6c-1406-48db-ad7c-ba1befdd2b79 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:23.162679 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ceeacf6c-1406-48db-ad7c-ba1befdd2b79 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:23.163306 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ceeacf6c-1406-48db-ad7c-ba1befdd2b79 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:23.163735 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ceeacf6c-1406-48db-ad7c-ba1befdd2b79 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:23.266362 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-49743094-c14f-47f2-b889-c66519a1bfc3 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:23.266973 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-49743094-c14f-47f2-b889-c66519a1bfc3 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:23.273273 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-49743094-c14f-47f2-b889-c66519a1bfc3 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:23.275091 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-49743094-c14f-47f2-b889-c66519a1bfc3 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:23.275548 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-49743094-c14f-47f2-b889-c66519a1bfc3 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:23.276249 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-49743094-c14f-47f2-b889-c66519a1bfc3 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:23.277170 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-49743094-c14f-47f2-b889-c66519a1bfc3 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:23.277296 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-49743094-c14f-47f2-b889-c66519a1bfc3 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:23.304453 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-ceeacf6c-1406-48db-ad7c-ba1befdd2b79 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:23.314214 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-ceeacf6c-1406-48db-ad7c-ba1befdd2b79 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1322 microversion: 2.1 time: 0.164185 Sep 25 04:36:23.329195 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 23/45] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:23 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:23.344043 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-49743094-c14f-47f2-b889-c66519a1bfc3 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:23.353195 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-49743094-c14f-47f2-b889-c66519a1bfc3 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1234 microversion: 2.1 time: 0.091047 Sep 25 04:36:23.353776 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 23/46] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:23 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1234 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:23.880000 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-1dc3a52e-995a-47b8-8742-5260b25d004e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:23.880602 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-1dc3a52e-995a-47b8-8742-5260b25d004e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:23.886461 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1dc3a52e-995a-47b8-8742-5260b25d004e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:23.886934 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1dc3a52e-995a-47b8-8742-5260b25d004e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:23.887377 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1dc3a52e-995a-47b8-8742-5260b25d004e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:23.888049 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1dc3a52e-995a-47b8-8742-5260b25d004e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:23.888494 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1dc3a52e-995a-47b8-8742-5260b25d004e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:23.888945 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1dc3a52e-995a-47b8-8742-5260b25d004e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:23.909062 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=100 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:23.956485 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-1dc3a52e-995a-47b8-8742-5260b25d004e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:23.964378 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-1dc3a52e-995a-47b8-8742-5260b25d004e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1292 microversion: 2.1 time: 0.088331 Sep 25 04:36:23.964985 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 24/47] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:23 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1292 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:24.075348 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-e719fbeb-0835-4129-8e31-fbd372b1de18 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:24.076100 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-e719fbeb-0835-4129-8e31-fbd372b1de18 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:24.082384 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e719fbeb-0835-4129-8e31-fbd372b1de18 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:24.082866 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e719fbeb-0835-4129-8e31-fbd372b1de18 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:24.083316 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e719fbeb-0835-4129-8e31-fbd372b1de18 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:24.083997 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e719fbeb-0835-4129-8e31-fbd372b1de18 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:24.084448 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e719fbeb-0835-4129-8e31-fbd372b1de18 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:24.085065 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e719fbeb-0835-4129-8e31-fbd372b1de18 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:24.118591 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-1f2c100a-ab05-41ab-8645-267cdd78fa22 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:24.119205 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-1f2c100a-ab05-41ab-8645-267cdd78fa22 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:24.125881 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1f2c100a-ab05-41ab-8645-267cdd78fa22 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:24.126371 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1f2c100a-ab05-41ab-8645-267cdd78fa22 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:24.126809 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1f2c100a-ab05-41ab-8645-267cdd78fa22 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:24.127510 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1f2c100a-ab05-41ab-8645-267cdd78fa22 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:24.127966 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1f2c100a-ab05-41ab-8645-267cdd78fa22 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:24.128389 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1f2c100a-ab05-41ab-8645-267cdd78fa22 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:24.145943 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-e719fbeb-0835-4129-8e31-fbd372b1de18 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:24.149351 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=100 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:24.155760 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-e719fbeb-0835-4129-8e31-fbd372b1de18 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:24.157236 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-e719fbeb-0835-4129-8e31-fbd372b1de18 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:24.158526 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-e719fbeb-0835-4129-8e31-fbd372b1de18 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1278 microversion: 2.20 time: 0.087042 Sep 25 04:36:24.159087 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 24/48] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:36:24 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1278 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:36:24.256998 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-1f2c100a-ab05-41ab-8645-267cdd78fa22 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:24.264988 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-1f2c100a-ab05-41ab-8645-267cdd78fa22 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1314 microversion: 2.1 time: 0.150127 Sep 25 04:36:24.265585 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 25/49] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:24 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:24.337947 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-03c0c1f6-0f80-46c1-8f26-9a7007bc30c2 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:24.338488 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-03c0c1f6-0f80-46c1-8f26-9a7007bc30c2 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:24.344585 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-03c0c1f6-0f80-46c1-8f26-9a7007bc30c2 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:24.345101 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-03c0c1f6-0f80-46c1-8f26-9a7007bc30c2 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:24.345537 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-03c0c1f6-0f80-46c1-8f26-9a7007bc30c2 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:24.346218 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-03c0c1f6-0f80-46c1-8f26-9a7007bc30c2 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:24.346669 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-03c0c1f6-0f80-46c1-8f26-9a7007bc30c2 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:24.347092 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-03c0c1f6-0f80-46c1-8f26-9a7007bc30c2 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:24.380051 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-1ceedddf-59ad-4ecc-81e7-3a8b69607b0d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:24.380730 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-1ceedddf-59ad-4ecc-81e7-3a8b69607b0d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:24.386710 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1ceedddf-59ad-4ecc-81e7-3a8b69607b0d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:24.387199 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1ceedddf-59ad-4ecc-81e7-3a8b69607b0d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:24.387641 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1ceedddf-59ad-4ecc-81e7-3a8b69607b0d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:24.388340 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1ceedddf-59ad-4ecc-81e7-3a8b69607b0d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:24.388828 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1ceedddf-59ad-4ecc-81e7-3a8b69607b0d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:24.389255 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1ceedddf-59ad-4ecc-81e7-3a8b69607b0d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:24.468395 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-1ceedddf-59ad-4ecc-81e7-3a8b69607b0d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:24.476671 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-1ceedddf-59ad-4ecc-81e7-3a8b69607b0d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1234 microversion: 2.1 time: 0.100362 Sep 25 04:36:24.477451 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 26/50] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:24 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1234 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:36:24.499149 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-03c0c1f6-0f80-46c1-8f26-9a7007bc30c2 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:24.507081 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-03c0c1f6-0f80-46c1-8f26-9a7007bc30c2 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1322 microversion: 2.1 time: 0.173016 Sep 25 04:36:24.507634 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 25/51] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:24 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:24.987058 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-cd12d689-c102-4b16-af74-a6dd96a846e4 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:24.987671 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-cd12d689-c102-4b16-af74-a6dd96a846e4 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:24.994903 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cd12d689-c102-4b16-af74-a6dd96a846e4 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:24.995394 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cd12d689-c102-4b16-af74-a6dd96a846e4 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:24.995834 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cd12d689-c102-4b16-af74-a6dd96a846e4 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:24.996533 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cd12d689-c102-4b16-af74-a6dd96a846e4 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:24.997022 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cd12d689-c102-4b16-af74-a6dd96a846e4 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:24.997503 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cd12d689-c102-4b16-af74-a6dd96a846e4 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:25.059255 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-cd12d689-c102-4b16-af74-a6dd96a846e4 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:25.067354 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-cd12d689-c102-4b16-af74-a6dd96a846e4 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1292 microversion: 2.1 time: 0.084250 Sep 25 04:36:25.067927 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 27/52] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:24 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1292 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:25.183832 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-d0ee6e77-5c36-4ed4-8d6f-ab6747b46805 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:25.184366 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-d0ee6e77-5c36-4ed4-8d6f-ab6747b46805 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:25.190990 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d0ee6e77-5c36-4ed4-8d6f-ab6747b46805 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:25.191479 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d0ee6e77-5c36-4ed4-8d6f-ab6747b46805 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:25.191915 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d0ee6e77-5c36-4ed4-8d6f-ab6747b46805 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:25.192602 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d0ee6e77-5c36-4ed4-8d6f-ab6747b46805 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:25.193080 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d0ee6e77-5c36-4ed4-8d6f-ab6747b46805 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:25.193504 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d0ee6e77-5c36-4ed4-8d6f-ab6747b46805 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:25.252798 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-d0ee6e77-5c36-4ed4-8d6f-ab6747b46805 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:25.260743 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-d0ee6e77-5c36-4ed4-8d6f-ab6747b46805 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:25.262196 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-d0ee6e77-5c36-4ed4-8d6f-ab6747b46805 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:25.263955 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-d0ee6e77-5c36-4ed4-8d6f-ab6747b46805 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1278 microversion: 2.20 time: 0.083749 Sep 25 04:36:25.264711 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 26/53] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:36:25 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1278 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:36:25.287198 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-a62afca4-de17-4d78-afcf-fcb32507875e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:25.287928 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-a62afca4-de17-4d78-afcf-fcb32507875e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:25.293934 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a62afca4-de17-4d78-afcf-fcb32507875e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:25.294685 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a62afca4-de17-4d78-afcf-fcb32507875e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:25.295294 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a62afca4-de17-4d78-afcf-fcb32507875e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:25.295983 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a62afca4-de17-4d78-afcf-fcb32507875e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:25.296448 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a62afca4-de17-4d78-afcf-fcb32507875e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:25.296901 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a62afca4-de17-4d78-afcf-fcb32507875e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:25.444384 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-a62afca4-de17-4d78-afcf-fcb32507875e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:25.454402 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-a62afca4-de17-4d78-afcf-fcb32507875e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1314 microversion: 2.1 time: 0.170995 Sep 25 04:36:25.455230 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 28/54] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:25 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:25.500549 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-aeb84009-a441-4f6f-91b0-38315387dbe0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:25.501365 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-aeb84009-a441-4f6f-91b0-38315387dbe0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:25.508666 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-aeb84009-a441-4f6f-91b0-38315387dbe0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:25.509357 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-aeb84009-a441-4f6f-91b0-38315387dbe0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:25.511362 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-aeb84009-a441-4f6f-91b0-38315387dbe0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:25.511362 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-aeb84009-a441-4f6f-91b0-38315387dbe0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:25.511362 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-aeb84009-a441-4f6f-91b0-38315387dbe0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:25.511651 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-aeb84009-a441-4f6f-91b0-38315387dbe0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:25.532950 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-9fa4569f-d417-478d-a324-af0b3bfac308 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:25.533795 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-9fa4569f-d417-478d-a324-af0b3bfac308 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:25.543857 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9fa4569f-d417-478d-a324-af0b3bfac308 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:25.544886 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9fa4569f-d417-478d-a324-af0b3bfac308 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:25.547373 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9fa4569f-d417-478d-a324-af0b3bfac308 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:25.547373 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9fa4569f-d417-478d-a324-af0b3bfac308 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:25.547373 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9fa4569f-d417-478d-a324-af0b3bfac308 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:25.547373 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9fa4569f-d417-478d-a324-af0b3bfac308 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:25.591153 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-aeb84009-a441-4f6f-91b0-38315387dbe0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:25.599359 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-aeb84009-a441-4f6f-91b0-38315387dbe0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1234 microversion: 2.1 time: 0.103327 Sep 25 04:36:25.600456 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 27/55] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:25 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1234 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:25.683626 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-9fa4569f-d417-478d-a324-af0b3bfac308 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:25.694104 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-9fa4569f-d417-478d-a324-af0b3bfac308 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1322 microversion: 2.1 time: 0.166532 Sep 25 04:36:25.694816 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 29/56] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:25 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:26.090586 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-f2550af7-d1c2-4a92-8ed5-38588bb9332e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:26.091715 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-f2550af7-d1c2-4a92-8ed5-38588bb9332e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:26.097708 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f2550af7-d1c2-4a92-8ed5-38588bb9332e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:26.098194 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f2550af7-d1c2-4a92-8ed5-38588bb9332e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:26.098663 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f2550af7-d1c2-4a92-8ed5-38588bb9332e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:26.099350 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f2550af7-d1c2-4a92-8ed5-38588bb9332e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:26.099807 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f2550af7-d1c2-4a92-8ed5-38588bb9332e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:26.100233 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f2550af7-d1c2-4a92-8ed5-38588bb9332e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:26.164417 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-f2550af7-d1c2-4a92-8ed5-38588bb9332e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:26.173003 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-f2550af7-d1c2-4a92-8ed5-38588bb9332e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1292 microversion: 2.1 time: 0.086063 Sep 25 04:36:26.173455 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 28/57] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:26 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1292 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:26.288823 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-0ee06db5-5a15-4d97-9e68-09ba269a1e2c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:26.289393 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-0ee06db5-5a15-4d97-9e68-09ba269a1e2c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:26.295879 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0ee06db5-5a15-4d97-9e68-09ba269a1e2c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:26.296367 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0ee06db5-5a15-4d97-9e68-09ba269a1e2c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:26.296839 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0ee06db5-5a15-4d97-9e68-09ba269a1e2c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:26.297524 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0ee06db5-5a15-4d97-9e68-09ba269a1e2c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:26.297981 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0ee06db5-5a15-4d97-9e68-09ba269a1e2c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:26.298406 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0ee06db5-5a15-4d97-9e68-09ba269a1e2c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:26.358263 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-0ee06db5-5a15-4d97-9e68-09ba269a1e2c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:26.366279 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-0ee06db5-5a15-4d97-9e68-09ba269a1e2c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:26.367792 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-0ee06db5-5a15-4d97-9e68-09ba269a1e2c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:26.368910 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-0ee06db5-5a15-4d97-9e68-09ba269a1e2c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1278 microversion: 2.20 time: 0.084091 Sep 25 04:36:26.369469 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 30/58] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:36:26 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1278 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:36:26.477355 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-73912c57-f6d3-436a-abc7-b37c77dbc86c tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:26.477995 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-73912c57-f6d3-436a-abc7-b37c77dbc86c tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:26.484176 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-73912c57-f6d3-436a-abc7-b37c77dbc86c tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:26.484697 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-73912c57-f6d3-436a-abc7-b37c77dbc86c tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:26.485138 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-73912c57-f6d3-436a-abc7-b37c77dbc86c tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:26.485829 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-73912c57-f6d3-436a-abc7-b37c77dbc86c tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:26.486286 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-73912c57-f6d3-436a-abc7-b37c77dbc86c tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:26.486711 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-73912c57-f6d3-436a-abc7-b37c77dbc86c tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:26.615854 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-73912c57-f6d3-436a-abc7-b37c77dbc86c tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:26.623501 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-1df30369-3e10-4e43-874d-038071d8c037 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:26.624141 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-1df30369-3e10-4e43-874d-038071d8c037 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:26.624447 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-73912c57-f6d3-436a-abc7-b37c77dbc86c tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1314 microversion: 2.1 time: 0.150975 Sep 25 04:36:26.625334 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 29/59] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:26 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:26.630190 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1df30369-3e10-4e43-874d-038071d8c037 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:26.630674 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1df30369-3e10-4e43-874d-038071d8c037 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:26.631107 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1df30369-3e10-4e43-874d-038071d8c037 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:26.631950 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1df30369-3e10-4e43-874d-038071d8c037 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:26.632240 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1df30369-3e10-4e43-874d-038071d8c037 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:26.632687 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1df30369-3e10-4e43-874d-038071d8c037 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:26.696699 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-1df30369-3e10-4e43-874d-038071d8c037 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:26.705554 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-1df30369-3e10-4e43-874d-038071d8c037 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1234 microversion: 2.1 time: 0.086129 Sep 25 04:36:26.706127 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 31/60] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:26 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1234 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:36:26.718330 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-1924dc43-7eb5-438f-8d1a-6b3a71ec69a3 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:26.719458 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-1924dc43-7eb5-438f-8d1a-6b3a71ec69a3 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:26.725184 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1924dc43-7eb5-438f-8d1a-6b3a71ec69a3 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:26.726073 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1924dc43-7eb5-438f-8d1a-6b3a71ec69a3 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:26.726579 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1924dc43-7eb5-438f-8d1a-6b3a71ec69a3 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:26.727338 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1924dc43-7eb5-438f-8d1a-6b3a71ec69a3 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:26.727889 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1924dc43-7eb5-438f-8d1a-6b3a71ec69a3 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:26.728403 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1924dc43-7eb5-438f-8d1a-6b3a71ec69a3 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:26.859839 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-1924dc43-7eb5-438f-8d1a-6b3a71ec69a3 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:26.867467 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-1924dc43-7eb5-438f-8d1a-6b3a71ec69a3 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1322 microversion: 2.1 time: 0.152936 Sep 25 04:36:26.868025 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 30/61] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:26 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:27.195793 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-2bf55f6a-53ba-45fc-8e4a-b923b4fa7fc6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:27.196408 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-2bf55f6a-53ba-45fc-8e4a-b923b4fa7fc6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:27.202518 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2bf55f6a-53ba-45fc-8e4a-b923b4fa7fc6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:27.203004 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2bf55f6a-53ba-45fc-8e4a-b923b4fa7fc6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:27.203830 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2bf55f6a-53ba-45fc-8e4a-b923b4fa7fc6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:27.204156 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2bf55f6a-53ba-45fc-8e4a-b923b4fa7fc6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:27.204615 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2bf55f6a-53ba-45fc-8e4a-b923b4fa7fc6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:27.205070 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2bf55f6a-53ba-45fc-8e4a-b923b4fa7fc6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:27.268380 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-2bf55f6a-53ba-45fc-8e4a-b923b4fa7fc6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:27.276180 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-2bf55f6a-53ba-45fc-8e4a-b923b4fa7fc6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1292 microversion: 2.1 time: 0.084232 Sep 25 04:36:27.276752 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 32/62] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:27 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1292 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:27.393644 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-c6a8d178-6d4b-4aca-92f5-044af718af08 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:27.394269 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-c6a8d178-6d4b-4aca-92f5-044af718af08 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:27.400157 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c6a8d178-6d4b-4aca-92f5-044af718af08 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:27.400666 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c6a8d178-6d4b-4aca-92f5-044af718af08 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:27.401095 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c6a8d178-6d4b-4aca-92f5-044af718af08 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:27.401774 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c6a8d178-6d4b-4aca-92f5-044af718af08 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:27.402219 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c6a8d178-6d4b-4aca-92f5-044af718af08 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:27.402637 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c6a8d178-6d4b-4aca-92f5-044af718af08 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:27.462729 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-c6a8d178-6d4b-4aca-92f5-044af718af08 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:27.471323 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-c6a8d178-6d4b-4aca-92f5-044af718af08 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:27.472826 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-c6a8d178-6d4b-4aca-92f5-044af718af08 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:27.473974 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-c6a8d178-6d4b-4aca-92f5-044af718af08 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1278 microversion: 2.20 time: 0.084250 Sep 25 04:36:27.474529 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 31/63] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:36:27 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1278 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:36:27.647448 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-34791b87-cbf8-4a8a-949c-2e0069127c17 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:27.648065 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-34791b87-cbf8-4a8a-949c-2e0069127c17 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:27.654627 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-34791b87-cbf8-4a8a-949c-2e0069127c17 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:27.655279 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-34791b87-cbf8-4a8a-949c-2e0069127c17 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:27.655697 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-34791b87-cbf8-4a8a-949c-2e0069127c17 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:27.656381 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-34791b87-cbf8-4a8a-949c-2e0069127c17 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:27.656870 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-34791b87-cbf8-4a8a-949c-2e0069127c17 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:27.657291 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-34791b87-cbf8-4a8a-949c-2e0069127c17 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:27.730217 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-b3cb2bb4-0398-43ea-8daf-b1eba690623a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:27.731428 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-b3cb2bb4-0398-43ea-8daf-b1eba690623a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:27.740019 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b3cb2bb4-0398-43ea-8daf-b1eba690623a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:27.740692 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b3cb2bb4-0398-43ea-8daf-b1eba690623a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:27.741250 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b3cb2bb4-0398-43ea-8daf-b1eba690623a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:27.742063 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b3cb2bb4-0398-43ea-8daf-b1eba690623a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:27.742602 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b3cb2bb4-0398-43ea-8daf-b1eba690623a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:27.743024 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b3cb2bb4-0398-43ea-8daf-b1eba690623a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:27.813521 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-b3cb2bb4-0398-43ea-8daf-b1eba690623a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:27.821047 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-b3cb2bb4-0398-43ea-8daf-b1eba690623a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1234 microversion: 2.1 time: 0.095850 Sep 25 04:36:27.821181 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-34791b87-cbf8-4a8a-949c-2e0069127c17 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:27.821836 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 32/64] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:27 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1234 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:27.836694 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-34791b87-cbf8-4a8a-949c-2e0069127c17 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1314 microversion: 2.1 time: 0.193108 Sep 25 04:36:27.837281 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 33/65] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:27 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:27.891489 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-f464f7cc-bf94-468e-b6c5-d52609c54f60 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:27.892239 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-f464f7cc-bf94-468e-b6c5-d52609c54f60 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:27.898475 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f464f7cc-bf94-468e-b6c5-d52609c54f60 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:27.898940 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f464f7cc-bf94-468e-b6c5-d52609c54f60 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:27.899376 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f464f7cc-bf94-468e-b6c5-d52609c54f60 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:27.900054 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f464f7cc-bf94-468e-b6c5-d52609c54f60 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:27.900502 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f464f7cc-bf94-468e-b6c5-d52609c54f60 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:27.900956 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f464f7cc-bf94-468e-b6c5-d52609c54f60 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:28.033288 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-f464f7cc-bf94-468e-b6c5-d52609c54f60 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:28.042270 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-f464f7cc-bf94-468e-b6c5-d52609c54f60 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1322 microversion: 2.1 time: 0.155439 Sep 25 04:36:28.042902 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 33/66] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:27 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:28.299432 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-5077572a-edf6-43b2-897b-2bc6c34a8aea tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:28.300216 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-5077572a-edf6-43b2-897b-2bc6c34a8aea tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:28.308789 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5077572a-edf6-43b2-897b-2bc6c34a8aea tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:28.309284 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5077572a-edf6-43b2-897b-2bc6c34a8aea tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:28.309736 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5077572a-edf6-43b2-897b-2bc6c34a8aea tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:28.311213 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5077572a-edf6-43b2-897b-2bc6c34a8aea tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:28.311674 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5077572a-edf6-43b2-897b-2bc6c34a8aea tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:28.312270 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5077572a-edf6-43b2-897b-2bc6c34a8aea tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:28.389582 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-5077572a-edf6-43b2-897b-2bc6c34a8aea tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:28.397797 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-5077572a-edf6-43b2-897b-2bc6c34a8aea tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1292 microversion: 2.1 time: 0.102441 Sep 25 04:36:28.398360 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 34/67] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:28 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1292 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:28.500169 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-9cb0580c-70c1-49fc-89c4-d550442f1dbf tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:28.500811 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-9cb0580c-70c1-49fc-89c4-d550442f1dbf tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:28.506692 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9cb0580c-70c1-49fc-89c4-d550442f1dbf tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:28.507176 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9cb0580c-70c1-49fc-89c4-d550442f1dbf tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:28.507618 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9cb0580c-70c1-49fc-89c4-d550442f1dbf tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:28.508294 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9cb0580c-70c1-49fc-89c4-d550442f1dbf tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:28.508772 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9cb0580c-70c1-49fc-89c4-d550442f1dbf tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:28.509261 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9cb0580c-70c1-49fc-89c4-d550442f1dbf tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:28.573739 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-9cb0580c-70c1-49fc-89c4-d550442f1dbf tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:28.584562 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-9cb0580c-70c1-49fc-89c4-d550442f1dbf tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:28.586605 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-9cb0580c-70c1-49fc-89c4-d550442f1dbf tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:28.587708 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-9cb0580c-70c1-49fc-89c4-d550442f1dbf tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1278 microversion: 2.20 time: 0.092326 Sep 25 04:36:28.588264 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 34/68] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:36:28 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1278 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:36:28.845862 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-91345853-c14d-4839-b0b8-d8248e18231a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:28.846401 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-91345853-c14d-4839-b0b8-d8248e18231a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:28.852405 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-91345853-c14d-4839-b0b8-d8248e18231a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:28.852936 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-91345853-c14d-4839-b0b8-d8248e18231a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:28.853378 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-91345853-c14d-4839-b0b8-d8248e18231a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:28.854104 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-91345853-c14d-4839-b0b8-d8248e18231a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:28.854560 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-91345853-c14d-4839-b0b8-d8248e18231a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:28.854996 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-91345853-c14d-4839-b0b8-d8248e18231a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:28.860720 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-21c2165f-5398-4dd0-a4d7-b51360195dd9 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:28.861354 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-21c2165f-5398-4dd0-a4d7-b51360195dd9 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:28.867569 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-21c2165f-5398-4dd0-a4d7-b51360195dd9 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:28.868051 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-21c2165f-5398-4dd0-a4d7-b51360195dd9 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:28.868479 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-21c2165f-5398-4dd0-a4d7-b51360195dd9 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:28.869188 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-21c2165f-5398-4dd0-a4d7-b51360195dd9 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:28.869636 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-21c2165f-5398-4dd0-a4d7-b51360195dd9 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:28.870085 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-21c2165f-5398-4dd0-a4d7-b51360195dd9 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:28.917974 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-91345853-c14d-4839-b0b8-d8248e18231a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:28.926745 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-91345853-c14d-4839-b0b8-d8248e18231a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1234 microversion: 2.1 time: 0.084808 Sep 25 04:36:28.927320 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 35/69] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:28 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1234 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:29.009311 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-21c2165f-5398-4dd0-a4d7-b51360195dd9 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:29.017233 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-21c2165f-5398-4dd0-a4d7-b51360195dd9 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1314 microversion: 2.1 time: 0.160979 Sep 25 04:36:29.017803 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 35/70] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:28 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:29.066112 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-d0af4e72-fb5e-4439-95ff-f7b2a1f65fc7 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:29.066719 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-d0af4e72-fb5e-4439-95ff-f7b2a1f65fc7 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:29.072597 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d0af4e72-fb5e-4439-95ff-f7b2a1f65fc7 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:29.073386 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d0af4e72-fb5e-4439-95ff-f7b2a1f65fc7 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:29.073818 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d0af4e72-fb5e-4439-95ff-f7b2a1f65fc7 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:29.074503 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d0af4e72-fb5e-4439-95ff-f7b2a1f65fc7 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:29.074952 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d0af4e72-fb5e-4439-95ff-f7b2a1f65fc7 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:29.075445 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d0af4e72-fb5e-4439-95ff-f7b2a1f65fc7 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:29.221088 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-d0af4e72-fb5e-4439-95ff-f7b2a1f65fc7 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:29.229271 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-d0af4e72-fb5e-4439-95ff-f7b2a1f65fc7 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1322 microversion: 2.1 time: 0.167449 Sep 25 04:36:29.229768 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 36/71] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:29 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:29.425556 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-9f2a0b01-1b5a-4f31-99b3-fe05e3623bc1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:29.426319 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-9f2a0b01-1b5a-4f31-99b3-fe05e3623bc1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:29.434055 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9f2a0b01-1b5a-4f31-99b3-fe05e3623bc1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:29.435393 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9f2a0b01-1b5a-4f31-99b3-fe05e3623bc1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:29.436097 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9f2a0b01-1b5a-4f31-99b3-fe05e3623bc1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:29.437403 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9f2a0b01-1b5a-4f31-99b3-fe05e3623bc1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:29.438634 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9f2a0b01-1b5a-4f31-99b3-fe05e3623bc1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:29.439390 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9f2a0b01-1b5a-4f31-99b3-fe05e3623bc1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:29.558783 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-9f2a0b01-1b5a-4f31-99b3-fe05e3623bc1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:29.574392 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-9f2a0b01-1b5a-4f31-99b3-fe05e3623bc1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1292 microversion: 2.1 time: 0.156821 Sep 25 04:36:29.575588 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 36/72] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:29 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1292 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:29.613794 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-a52b083f-4508-4ea7-a4ee-38439b825b90 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:29.614833 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-a52b083f-4508-4ea7-a4ee-38439b825b90 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:29.621252 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a52b083f-4508-4ea7-a4ee-38439b825b90 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:29.621736 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a52b083f-4508-4ea7-a4ee-38439b825b90 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:29.622164 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a52b083f-4508-4ea7-a4ee-38439b825b90 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:29.623882 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a52b083f-4508-4ea7-a4ee-38439b825b90 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:29.624477 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a52b083f-4508-4ea7-a4ee-38439b825b90 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:29.624937 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a52b083f-4508-4ea7-a4ee-38439b825b90 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:29.699387 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-a52b083f-4508-4ea7-a4ee-38439b825b90 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:29.711871 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-a52b083f-4508-4ea7-a4ee-38439b825b90 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:29.713935 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-a52b083f-4508-4ea7-a4ee-38439b825b90 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:29.715100 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-a52b083f-4508-4ea7-a4ee-38439b825b90 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1278 microversion: 2.20 time: 0.105246 Sep 25 04:36:29.715846 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 37/73] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:36:29 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1278 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 04:36:29.951552 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-00ac4820-7517-4563-8d1e-59bdc4d603cb tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:29.952165 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-00ac4820-7517-4563-8d1e-59bdc4d603cb tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:29.959192 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-00ac4820-7517-4563-8d1e-59bdc4d603cb tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:29.959914 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-00ac4820-7517-4563-8d1e-59bdc4d603cb tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:29.960557 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-00ac4820-7517-4563-8d1e-59bdc4d603cb tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:29.961493 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-00ac4820-7517-4563-8d1e-59bdc4d603cb tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:29.962126 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-00ac4820-7517-4563-8d1e-59bdc4d603cb tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:29.962726 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-00ac4820-7517-4563-8d1e-59bdc4d603cb tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:30.050228 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-4f7cf41c-5a89-4dc1-9aa7-9f9d5447ccf9 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:30.050688 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-00ac4820-7517-4563-8d1e-59bdc4d603cb tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:30.051007 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-4f7cf41c-5a89-4dc1-9aa7-9f9d5447ccf9 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:30.058938 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4f7cf41c-5a89-4dc1-9aa7-9f9d5447ccf9 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:30.059810 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4f7cf41c-5a89-4dc1-9aa7-9f9d5447ccf9 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:30.060300 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4f7cf41c-5a89-4dc1-9aa7-9f9d5447ccf9 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:30.062121 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-00ac4820-7517-4563-8d1e-59bdc4d603cb tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1234 microversion: 2.1 time: 0.114446 Sep 25 04:36:30.062610 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4f7cf41c-5a89-4dc1-9aa7-9f9d5447ccf9 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:30.063357 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4f7cf41c-5a89-4dc1-9aa7-9f9d5447ccf9 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:30.063600 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 37/74] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:29 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1234 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:30.064258 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4f7cf41c-5a89-4dc1-9aa7-9f9d5447ccf9 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:30.255758 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-0179df98-e97a-423b-996a-39fd04ff02cf tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:30.257984 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-0179df98-e97a-423b-996a-39fd04ff02cf tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:30.267103 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0179df98-e97a-423b-996a-39fd04ff02cf tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:30.267792 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0179df98-e97a-423b-996a-39fd04ff02cf tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:30.268423 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0179df98-e97a-423b-996a-39fd04ff02cf tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:30.269141 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0179df98-e97a-423b-996a-39fd04ff02cf tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:30.269746 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0179df98-e97a-423b-996a-39fd04ff02cf tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:30.270601 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0179df98-e97a-423b-996a-39fd04ff02cf tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:30.298890 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell0:SELECT=4 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:30.405843 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-4f7cf41c-5a89-4dc1-9aa7-9f9d5447ccf9 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:30.414401 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-4f7cf41c-5a89-4dc1-9aa7-9f9d5447ccf9 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1314 microversion: 2.1 time: 0.375464 Sep 25 04:36:30.415208 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 38/75] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:30 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:30.470241 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-0179df98-e97a-423b-996a-39fd04ff02cf tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:30.479414 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-0179df98-e97a-423b-996a-39fd04ff02cf tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1322 microversion: 2.1 time: 0.229133 Sep 25 04:36:30.480482 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 38/76] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:30 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:36:30.601735 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-cb2279cf-8cd1-4cb5-b132-c451b4d6c819 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:30.602580 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-cb2279cf-8cd1-4cb5-b132-c451b4d6c819 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:30.614182 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cb2279cf-8cd1-4cb5-b132-c451b4d6c819 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:30.615189 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cb2279cf-8cd1-4cb5-b132-c451b4d6c819 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:30.616027 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cb2279cf-8cd1-4cb5-b132-c451b4d6c819 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:30.617441 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cb2279cf-8cd1-4cb5-b132-c451b4d6c819 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:30.618272 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cb2279cf-8cd1-4cb5-b132-c451b4d6c819 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:30.619566 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cb2279cf-8cd1-4cb5-b132-c451b4d6c819 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:30.710888 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-cb2279cf-8cd1-4cb5-b132-c451b4d6c819 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:30.720481 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-cb2279cf-8cd1-4cb5-b132-c451b4d6c819 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1300 microversion: 2.1 time: 0.125871 Sep 25 04:36:30.721218 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 39/77] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:30 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1300 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:30.745075 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-94db124a-4848-4411-a621-71be89a967c1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:30.746950 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-94db124a-4848-4411-a621-71be89a967c1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:30.756009 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-94db124a-4848-4411-a621-71be89a967c1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:30.756531 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-94db124a-4848-4411-a621-71be89a967c1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:30.757024 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-94db124a-4848-4411-a621-71be89a967c1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:30.757719 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-94db124a-4848-4411-a621-71be89a967c1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:30.758234 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-94db124a-4848-4411-a621-71be89a967c1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:30.758910 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-94db124a-4848-4411-a621-71be89a967c1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:30.822923 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-94db124a-4848-4411-a621-71be89a967c1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:30.831902 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-94db124a-4848-4411-a621-71be89a967c1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:30.833666 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-94db124a-4848-4411-a621-71be89a967c1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:30.835031 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-94db124a-4848-4411-a621-71be89a967c1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1278 microversion: 2.20 time: 0.095735 Sep 25 04:36:30.835583 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 39/78] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:36:30 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1278 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:36:31.090956 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-7f334428-0bfb-498a-b573-0ee24c762940 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:31.091573 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-7f334428-0bfb-498a-b573-0ee24c762940 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:31.099666 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7f334428-0bfb-498a-b573-0ee24c762940 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:31.100151 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7f334428-0bfb-498a-b573-0ee24c762940 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:31.100595 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7f334428-0bfb-498a-b573-0ee24c762940 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:31.101330 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7f334428-0bfb-498a-b573-0ee24c762940 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:31.101788 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7f334428-0bfb-498a-b573-0ee24c762940 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:31.102217 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7f334428-0bfb-498a-b573-0ee24c762940 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:31.141782 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell0:SELECT=6 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:31.164744 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell0:SELECT=12 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:31.173996 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-7f334428-0bfb-498a-b573-0ee24c762940 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:31.183350 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-7f334428-0bfb-498a-b573-0ee24c762940 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1290 microversion: 2.1 time: 0.096094 Sep 25 04:36:31.184376 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 40/79] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:31 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1290 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:31.440511 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-752d6421-caba-4b57-bbcd-df900f78a133 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:31.441141 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-752d6421-caba-4b57-bbcd-df900f78a133 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:31.447098 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-752d6421-caba-4b57-bbcd-df900f78a133 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:31.447576 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-752d6421-caba-4b57-bbcd-df900f78a133 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:31.448003 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-752d6421-caba-4b57-bbcd-df900f78a133 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:31.448711 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-752d6421-caba-4b57-bbcd-df900f78a133 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:31.449161 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-752d6421-caba-4b57-bbcd-df900f78a133 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:31.449577 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-752d6421-caba-4b57-bbcd-df900f78a133 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:31.483688 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell0:SELECT=30 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:31.505809 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-734098fc-e363-4d12-ba6d-f4da43cbcbf9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:31.506737 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-734098fc-e363-4d12-ba6d-f4da43cbcbf9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:31.514184 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-734098fc-e363-4d12-ba6d-f4da43cbcbf9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:31.514937 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-734098fc-e363-4d12-ba6d-f4da43cbcbf9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:31.515477 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-734098fc-e363-4d12-ba6d-f4da43cbcbf9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:31.516402 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-734098fc-e363-4d12-ba6d-f4da43cbcbf9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:31.516945 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-734098fc-e363-4d12-ba6d-f4da43cbcbf9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:31.517387 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-734098fc-e363-4d12-ba6d-f4da43cbcbf9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:31.521715 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=100 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:31.632083 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-752d6421-caba-4b57-bbcd-df900f78a133 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:31.640901 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-752d6421-caba-4b57-bbcd-df900f78a133 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1314 microversion: 2.1 time: 0.204248 Sep 25 04:36:31.641597 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 40/80] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:31 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:31.678520 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-734098fc-e363-4d12-ba6d-f4da43cbcbf9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:31.686913 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-734098fc-e363-4d12-ba6d-f4da43cbcbf9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1322 microversion: 2.1 time: 0.185439 Sep 25 04:36:31.687482 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 41/81] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:31 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:36:31.745991 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-d7ff3237-bd59-478c-a2d0-ecbf5d98e0b7 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:31.746744 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-d7ff3237-bd59-478c-a2d0-ecbf5d98e0b7 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:31.759945 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d7ff3237-bd59-478c-a2d0-ecbf5d98e0b7 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:31.761014 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d7ff3237-bd59-478c-a2d0-ecbf5d98e0b7 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:31.762212 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d7ff3237-bd59-478c-a2d0-ecbf5d98e0b7 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:31.763563 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d7ff3237-bd59-478c-a2d0-ecbf5d98e0b7 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:31.764396 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d7ff3237-bd59-478c-a2d0-ecbf5d98e0b7 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:31.765066 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d7ff3237-bd59-478c-a2d0-ecbf5d98e0b7 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:31.785484 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=100 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:31.834132 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-d7ff3237-bd59-478c-a2d0-ecbf5d98e0b7 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:31.842084 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-d7ff3237-bd59-478c-a2d0-ecbf5d98e0b7 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1300 microversion: 2.1 time: 0.100244 Sep 25 04:36:31.842734 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 41/82] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:31 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1300 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:31.860166 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-b84bd7f4-cdaf-4827-bdbb-b65825f2eefb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:31.860820 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-b84bd7f4-cdaf-4827-bdbb-b65825f2eefb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:31.866795 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b84bd7f4-cdaf-4827-bdbb-b65825f2eefb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:31.867281 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b84bd7f4-cdaf-4827-bdbb-b65825f2eefb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:31.867714 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b84bd7f4-cdaf-4827-bdbb-b65825f2eefb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:31.871216 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b84bd7f4-cdaf-4827-bdbb-b65825f2eefb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:31.871689 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b84bd7f4-cdaf-4827-bdbb-b65825f2eefb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:31.872172 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b84bd7f4-cdaf-4827-bdbb-b65825f2eefb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:31.935425 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-b84bd7f4-cdaf-4827-bdbb-b65825f2eefb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:31.944381 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-b84bd7f4-cdaf-4827-bdbb-b65825f2eefb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:31.945881 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-b84bd7f4-cdaf-4827-bdbb-b65825f2eefb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:31.946986 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-b84bd7f4-cdaf-4827-bdbb-b65825f2eefb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1278 microversion: 2.20 time: 0.091515 Sep 25 04:36:31.947533 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 42/83] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:36:31 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1278 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:36:32.207902 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-2b75d1a7-dd69-404e-b326-99d8809faa24 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:32.208507 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-2b75d1a7-dd69-404e-b326-99d8809faa24 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:32.214393 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2b75d1a7-dd69-404e-b326-99d8809faa24 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:32.214881 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2b75d1a7-dd69-404e-b326-99d8809faa24 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:32.215308 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2b75d1a7-dd69-404e-b326-99d8809faa24 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:32.217098 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2b75d1a7-dd69-404e-b326-99d8809faa24 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:32.217756 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2b75d1a7-dd69-404e-b326-99d8809faa24 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:32.218183 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2b75d1a7-dd69-404e-b326-99d8809faa24 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:32.296218 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-2b75d1a7-dd69-404e-b326-99d8809faa24 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:32.306463 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-2b75d1a7-dd69-404e-b326-99d8809faa24 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1290 microversion: 2.1 time: 0.102591 Sep 25 04:36:32.324726 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 42/84] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:32 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1290 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:32.663811 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-9dade00a-2300-4a0d-8229-19812666adce tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:32.664499 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-9dade00a-2300-4a0d-8229-19812666adce tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:32.671268 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9dade00a-2300-4a0d-8229-19812666adce tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:32.671756 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9dade00a-2300-4a0d-8229-19812666adce tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:32.686425 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9dade00a-2300-4a0d-8229-19812666adce tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:32.687358 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9dade00a-2300-4a0d-8229-19812666adce tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:32.687841 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9dade00a-2300-4a0d-8229-19812666adce tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:32.688306 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9dade00a-2300-4a0d-8229-19812666adce tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:32.714138 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-2300a262-085c-4c14-ba1c-5ac2bfcf947b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:32.714757 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-2300a262-085c-4c14-ba1c-5ac2bfcf947b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:32.734413 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2300a262-085c-4c14-ba1c-5ac2bfcf947b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:32.737581 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2300a262-085c-4c14-ba1c-5ac2bfcf947b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:32.738973 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2300a262-085c-4c14-ba1c-5ac2bfcf947b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:32.743766 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2300a262-085c-4c14-ba1c-5ac2bfcf947b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:32.745761 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2300a262-085c-4c14-ba1c-5ac2bfcf947b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:32.746242 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2300a262-085c-4c14-ba1c-5ac2bfcf947b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:33.568254 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-9dade00a-2300-4a0d-8229-19812666adce tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:33.576915 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-2300a262-085c-4c14-ba1c-5ac2bfcf947b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:33.579278 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-9dade00a-2300-4a0d-8229-19812666adce tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1314 microversion: 2.1 time: 0.919516 Sep 25 04:36:33.579871 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 43/85] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:32 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1314 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:33.589512 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-24c8ed18-4522-458d-b6ec-507f0adeff21 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:33.590117 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-24c8ed18-4522-458d-b6ec-507f0adeff21 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:33.593775 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-2300a262-085c-4c14-ba1c-5ac2bfcf947b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1322 microversion: 2.1 time: 0.883484 Sep 25 04:36:33.594355 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 43/86] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:32 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1322 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:36:33.596151 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-24c8ed18-4522-458d-b6ec-507f0adeff21 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:33.596694 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-24c8ed18-4522-458d-b6ec-507f0adeff21 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:33.597132 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-24c8ed18-4522-458d-b6ec-507f0adeff21 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:33.597944 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-24c8ed18-4522-458d-b6ec-507f0adeff21 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:33.598398 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-24c8ed18-4522-458d-b6ec-507f0adeff21 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:33.598859 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-24c8ed18-4522-458d-b6ec-507f0adeff21 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:33.600257 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-2313db63-ff70-4453-939b-16122cf38fad tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:33.600957 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-2313db63-ff70-4453-939b-16122cf38fad tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:33.607998 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2313db63-ff70-4453-939b-16122cf38fad tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:33.608523 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2313db63-ff70-4453-939b-16122cf38fad tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:33.608995 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2313db63-ff70-4453-939b-16122cf38fad tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:33.609877 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2313db63-ff70-4453-939b-16122cf38fad tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:33.610332 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2313db63-ff70-4453-939b-16122cf38fad tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:33.610786 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2313db63-ff70-4453-939b-16122cf38fad tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:33.669877 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-24c8ed18-4522-458d-b6ec-507f0adeff21 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:33.677644 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-24c8ed18-4522-458d-b6ec-507f0adeff21 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1298 microversion: 2.1 time: 0.091806 Sep 25 04:36:33.678303 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 44/87] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:33 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1298 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:33.685673 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-f528f283-7bcb-4c2a-b594-e79bb762afcd tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:33.686774 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-f528f283-7bcb-4c2a-b594-e79bb762afcd tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:33.689552 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-2313db63-ff70-4453-939b-16122cf38fad tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:33.693273 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f528f283-7bcb-4c2a-b594-e79bb762afcd tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:33.693762 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f528f283-7bcb-4c2a-b594-e79bb762afcd tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:33.694194 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f528f283-7bcb-4c2a-b594-e79bb762afcd tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:33.694981 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f528f283-7bcb-4c2a-b594-e79bb762afcd tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:33.695433 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f528f283-7bcb-4c2a-b594-e79bb762afcd tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:33.695854 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f528f283-7bcb-4c2a-b594-e79bb762afcd tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:33.702789 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-2313db63-ff70-4453-939b-16122cf38fad tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:33.704296 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-2313db63-ff70-4453-939b-16122cf38fad tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:33.705428 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-2313db63-ff70-4453-939b-16122cf38fad tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1334 microversion: 2.20 time: 0.109688 Sep 25 04:36:33.706012 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 44/88] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:36:33 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1334 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:36:33.757857 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-f528f283-7bcb-4c2a-b594-e79bb762afcd tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:33.766340 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-f528f283-7bcb-4c2a-b594-e79bb762afcd tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1298 microversion: 2.1 time: 0.086935 Sep 25 04:36:33.766899 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 45/89] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:33 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1298 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:34.602834 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-0b527d18-b748-45f4-8b7d-70aae6791877 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:34.603450 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-0b527d18-b748-45f4-8b7d-70aae6791877 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:34.611368 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0b527d18-b748-45f4-8b7d-70aae6791877 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:34.611857 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0b527d18-b748-45f4-8b7d-70aae6791877 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:34.612491 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0b527d18-b748-45f4-8b7d-70aae6791877 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:34.613272 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0b527d18-b748-45f4-8b7d-70aae6791877 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:34.613723 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0b527d18-b748-45f4-8b7d-70aae6791877 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:34.614440 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0b527d18-b748-45f4-8b7d-70aae6791877 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:34.615894 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-f17a3452-e259-46d5-a68e-093296b2711c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:34.616530 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-f17a3452-e259-46d5-a68e-093296b2711c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:34.626717 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f17a3452-e259-46d5-a68e-093296b2711c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:34.631106 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f17a3452-e259-46d5-a68e-093296b2711c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:34.631711 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f17a3452-e259-46d5-a68e-093296b2711c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:34.634045 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f17a3452-e259-46d5-a68e-093296b2711c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:34.634634 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f17a3452-e259-46d5-a68e-093296b2711c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:34.635571 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f17a3452-e259-46d5-a68e-093296b2711c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:34.861096 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-0b527d18-b748-45f4-8b7d-70aae6791877 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:34.870824 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-0b527d18-b748-45f4-8b7d-70aae6791877 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1314 microversion: 2.1 time: 0.272285 Sep 25 04:36:34.874282 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 45/90] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:34 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:34.885226 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-53e589dd-813e-4b3f-b8ab-da0251648988 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:34.886124 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-53e589dd-813e-4b3f-b8ab-da0251648988 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:34.902475 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-53e589dd-813e-4b3f-b8ab-da0251648988 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:34.906157 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-53e589dd-813e-4b3f-b8ab-da0251648988 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:34.908288 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-53e589dd-813e-4b3f-b8ab-da0251648988 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:34.910064 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-53e589dd-813e-4b3f-b8ab-da0251648988 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:34.911534 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-53e589dd-813e-4b3f-b8ab-da0251648988 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:34.912753 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-53e589dd-813e-4b3f-b8ab-da0251648988 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:34.953838 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-f17a3452-e259-46d5-a68e-093296b2711c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:34.962460 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-f17a3452-e259-46d5-a68e-093296b2711c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1322 microversion: 2.1 time: 0.350590 Sep 25 04:36:34.977945 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 46/91] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:34 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1322 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:34.986002 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-78c919d8-2466-462e-bd08-486005a2d8c1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:34.993408 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-78c919d8-2466-462e-bd08-486005a2d8c1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:35.000691 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-53e589dd-813e-4b3f-b8ab-da0251648988 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:35.001506 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-78c919d8-2466-462e-bd08-486005a2d8c1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:35.002140 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-78c919d8-2466-462e-bd08-486005a2d8c1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:35.002576 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-78c919d8-2466-462e-bd08-486005a2d8c1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:35.003263 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-78c919d8-2466-462e-bd08-486005a2d8c1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:35.003707 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-78c919d8-2466-462e-bd08-486005a2d8c1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:35.004123 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-78c919d8-2466-462e-bd08-486005a2d8c1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:35.009769 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-53e589dd-813e-4b3f-b8ab-da0251648988 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1298 microversion: 2.1 time: 0.134311 Sep 25 04:36:35.010692 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 46/92] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:34 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1298 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:35.016999 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-9e1f0d7e-b2d1-4bc7-b91a-ba083aaf66e8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:35.017691 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-9e1f0d7e-b2d1-4bc7-b91a-ba083aaf66e8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:35.023954 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9e1f0d7e-b2d1-4bc7-b91a-ba083aaf66e8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:35.024519 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9e1f0d7e-b2d1-4bc7-b91a-ba083aaf66e8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:35.025057 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9e1f0d7e-b2d1-4bc7-b91a-ba083aaf66e8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:35.025987 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9e1f0d7e-b2d1-4bc7-b91a-ba083aaf66e8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:35.026516 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9e1f0d7e-b2d1-4bc7-b91a-ba083aaf66e8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:35.027019 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9e1f0d7e-b2d1-4bc7-b91a-ba083aaf66e8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:35.074080 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-78c919d8-2466-462e-bd08-486005a2d8c1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:35.083420 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-78c919d8-2466-462e-bd08-486005a2d8c1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:35.084898 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-78c919d8-2466-462e-bd08-486005a2d8c1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:35.086006 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-78c919d8-2466-462e-bd08-486005a2d8c1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1334 microversion: 2.20 time: 0.106751 Sep 25 04:36:35.086846 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 47/93] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:36:34 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1334 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:36:35.108125 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-9e1f0d7e-b2d1-4bc7-b91a-ba083aaf66e8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:35.117341 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-9e1f0d7e-b2d1-4bc7-b91a-ba083aaf66e8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1298 microversion: 2.1 time: 0.105517 Sep 25 04:36:35.117903 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 47/94] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:35 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1298 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:35.153869 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-51eab21c-9b77-433a-a55c-40e3d6ef3c6a req-219a8d05-e815-4035-8491-25dedc932345 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a4fe760-3afd-42e5-9909-86ca268c9b96", "name": "network-vif-plugged", "status": "completed", "tag": "320631df-79bd-4e26-a748-a2b0a3daee05"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:36:35.163165 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-51eab21c-9b77-433a-a55c-40e3d6ef3c6a req-219a8d05-e815-4035-8491-25dedc932345 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:35.163783 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-51eab21c-9b77-433a-a55c-40e3d6ef3c6a req-219a8d05-e815-4035-8491-25dedc932345 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:35.164178 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-51eab21c-9b77-433a-a55c-40e3d6ef3c6a req-219a8d05-e815-4035-8491-25dedc932345 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:35.176198 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-51eab21c-9b77-433a-a55c-40e3d6ef3c6a req-219a8d05-e815-4035-8491-25dedc932345 service nova] Creating event network-vif-plugged:320631df-79bd-4e26-a748-a2b0a3daee05 for instance 8a4fe760-3afd-42e5-9909-86ca268c9b96 on hv-cinder-85535 Sep 25 04:36:35.181206 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-51eab21c-9b77-433a-a55c-40e3d6ef3c6a req-219a8d05-e815-4035-8491-25dedc932345 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093351 Sep 25 04:36:35.181799 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 48/95] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:36:35.897691 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-4502b869-9074-458b-a2cd-7a9e39c95fbb tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:35.898310 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-4502b869-9074-458b-a2cd-7a9e39c95fbb tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:35.905123 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4502b869-9074-458b-a2cd-7a9e39c95fbb tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:35.905612 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4502b869-9074-458b-a2cd-7a9e39c95fbb tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:35.906049 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4502b869-9074-458b-a2cd-7a9e39c95fbb tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:35.907073 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4502b869-9074-458b-a2cd-7a9e39c95fbb tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:35.907537 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4502b869-9074-458b-a2cd-7a9e39c95fbb tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:35.907970 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4502b869-9074-458b-a2cd-7a9e39c95fbb tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:35.993454 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-ad880c07-cf65-47a3-b275-e5408b3175e8 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:35.994156 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-ad880c07-cf65-47a3-b275-e5408b3175e8 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:36.000880 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ad880c07-cf65-47a3-b275-e5408b3175e8 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:36.001368 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ad880c07-cf65-47a3-b275-e5408b3175e8 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:36.001985 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ad880c07-cf65-47a3-b275-e5408b3175e8 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:36.002723 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ad880c07-cf65-47a3-b275-e5408b3175e8 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:36.003181 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ad880c07-cf65-47a3-b275-e5408b3175e8 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:36.003607 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ad880c07-cf65-47a3-b275-e5408b3175e8 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:36.044931 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-4502b869-9074-458b-a2cd-7a9e39c95fbb tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:36.052929 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-4502b869-9074-458b-a2cd-7a9e39c95fbb tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1314 microversion: 2.1 time: 0.159019 Sep 25 04:36:36.053500 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 48/96] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:35 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:36.058142 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-1880aaa6-9e59-46b9-ab63-605679a4d287 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:36.058942 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-1880aaa6-9e59-46b9-ab63-605679a4d287 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:36.065067 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1880aaa6-9e59-46b9-ab63-605679a4d287 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:36.065691 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1880aaa6-9e59-46b9-ab63-605679a4d287 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:36.066125 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1880aaa6-9e59-46b9-ab63-605679a4d287 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:36.066806 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1880aaa6-9e59-46b9-ab63-605679a4d287 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:36.067257 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1880aaa6-9e59-46b9-ab63-605679a4d287 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:36.067676 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1880aaa6-9e59-46b9-ab63-605679a4d287 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:36.140116 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-1880aaa6-9e59-46b9-ab63-605679a4d287 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:36.147806 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-1880aaa6-9e59-46b9-ab63-605679a4d287 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1298 microversion: 2.1 time: 0.093284 Sep 25 04:36:36.148480 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 49/97] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:36 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1298 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:36.152722 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-437bd471-e332-4398-bcc7-068cd7367ef8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:36.153537 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-437bd471-e332-4398-bcc7-068cd7367ef8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:36.159229 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-437bd471-e332-4398-bcc7-068cd7367ef8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:36.159718 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-437bd471-e332-4398-bcc7-068cd7367ef8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:36.160150 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-437bd471-e332-4398-bcc7-068cd7367ef8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:36.160873 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-437bd471-e332-4398-bcc7-068cd7367ef8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:36.161334 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-437bd471-e332-4398-bcc7-068cd7367ef8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:36.161755 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-437bd471-e332-4398-bcc7-068cd7367ef8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:36.175539 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-ad880c07-cf65-47a3-b275-e5408b3175e8 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:36.183168 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-ad880c07-cf65-47a3-b275-e5408b3175e8 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1322 microversion: 2.1 time: 0.196357 Sep 25 04:36:36.183734 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 49/98] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:35 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:36:36.189165 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-06ecf82c-f5c3-4b9c-b224-aadb9849d817 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:36.189773 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-06ecf82c-f5c3-4b9c-b224-aadb9849d817 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:36.195495 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-06ecf82c-f5c3-4b9c-b224-aadb9849d817 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:36.195988 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-06ecf82c-f5c3-4b9c-b224-aadb9849d817 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:36.196428 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-06ecf82c-f5c3-4b9c-b224-aadb9849d817 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:36.197144 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-06ecf82c-f5c3-4b9c-b224-aadb9849d817 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:36.197598 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-06ecf82c-f5c3-4b9c-b224-aadb9849d817 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:36.198207 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-06ecf82c-f5c3-4b9c-b224-aadb9849d817 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:36.224253 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-437bd471-e332-4398-bcc7-068cd7367ef8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:36.233964 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-437bd471-e332-4398-bcc7-068cd7367ef8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:36.235574 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-437bd471-e332-4398-bcc7-068cd7367ef8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:36.236707 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-437bd471-e332-4398-bcc7-068cd7367ef8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1334 microversion: 2.20 time: 0.087441 Sep 25 04:36:36.237264 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 50/99] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:36:36 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1334 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:36:36.260812 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-06ecf82c-f5c3-4b9c-b224-aadb9849d817 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:36.268888 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-06ecf82c-f5c3-4b9c-b224-aadb9849d817 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1298 microversion: 2.1 time: 0.084125 Sep 25 04:36:36.269452 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 50/100] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:36 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1298 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:37.075833 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-cd508210-421c-4ad6-8df4-7f664eecf7ca tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:37.076695 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-cd508210-421c-4ad6-8df4-7f664eecf7ca tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:37.082916 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cd508210-421c-4ad6-8df4-7f664eecf7ca tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:37.083404 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cd508210-421c-4ad6-8df4-7f664eecf7ca tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:37.083843 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cd508210-421c-4ad6-8df4-7f664eecf7ca tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:37.085161 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cd508210-421c-4ad6-8df4-7f664eecf7ca tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:37.085625 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cd508210-421c-4ad6-8df4-7f664eecf7ca tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:37.086053 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cd508210-421c-4ad6-8df4-7f664eecf7ca tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:37.172007 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-f2d138d2-9132-4e1e-8db5-cc13caf36415 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:37.172624 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-f2d138d2-9132-4e1e-8db5-cc13caf36415 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:37.178671 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f2d138d2-9132-4e1e-8db5-cc13caf36415 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:37.179134 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f2d138d2-9132-4e1e-8db5-cc13caf36415 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:37.179568 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f2d138d2-9132-4e1e-8db5-cc13caf36415 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:37.180253 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f2d138d2-9132-4e1e-8db5-cc13caf36415 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:37.180730 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f2d138d2-9132-4e1e-8db5-cc13caf36415 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:37.181156 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f2d138d2-9132-4e1e-8db5-cc13caf36415 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:37.214560 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-cd508210-421c-4ad6-8df4-7f664eecf7ca tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:37.224302 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-cd508210-421c-4ad6-8df4-7f664eecf7ca tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1314 microversion: 2.1 time: 0.152809 Sep 25 04:36:37.224907 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 51/101] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:37 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:37.229441 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-878981de-8467-45c8-9269-601ed42ac7e5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:37.230047 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-878981de-8467-45c8-9269-601ed42ac7e5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:37.235784 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-878981de-8467-45c8-9269-601ed42ac7e5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:37.236271 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-878981de-8467-45c8-9269-601ed42ac7e5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:37.236760 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-878981de-8467-45c8-9269-601ed42ac7e5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:37.237618 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-878981de-8467-45c8-9269-601ed42ac7e5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:37.238081 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-878981de-8467-45c8-9269-601ed42ac7e5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:37.238509 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-878981de-8467-45c8-9269-601ed42ac7e5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:37.244417 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-f2d138d2-9132-4e1e-8db5-cc13caf36415 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:37.253973 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-f2d138d2-9132-4e1e-8db5-cc13caf36415 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1298 microversion: 2.1 time: 0.086084 Sep 25 04:36:37.254819 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 51/102] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:37 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1298 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:36:37.265629 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-bfe4f905-b2cc-48a4-9877-5c0989de927e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:37.267275 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-bfe4f905-b2cc-48a4-9877-5c0989de927e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:37.274410 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bfe4f905-b2cc-48a4-9877-5c0989de927e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:37.274893 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bfe4f905-b2cc-48a4-9877-5c0989de927e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:37.275329 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bfe4f905-b2cc-48a4-9877-5c0989de927e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:37.276051 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bfe4f905-b2cc-48a4-9877-5c0989de927e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:37.276503 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bfe4f905-b2cc-48a4-9877-5c0989de927e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:37.276988 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bfe4f905-b2cc-48a4-9877-5c0989de927e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:37.353159 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-bfe4f905-b2cc-48a4-9877-5c0989de927e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:37.361414 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-bfe4f905-b2cc-48a4-9877-5c0989de927e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:37.362872 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-bfe4f905-b2cc-48a4-9877-5c0989de927e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:37.363969 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-bfe4f905-b2cc-48a4-9877-5c0989de927e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1334 microversion: 2.20 time: 0.105576 Sep 25 04:36:37.364541 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 52/103] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:36:37 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1334 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 04:36:37.368943 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-2b0899d2-a250-49c5-9fdf-6a56b777833b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:37.369546 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-2b0899d2-a250-49c5-9fdf-6a56b777833b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:37.376069 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2b0899d2-a250-49c5-9fdf-6a56b777833b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:37.376561 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2b0899d2-a250-49c5-9fdf-6a56b777833b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:37.377035 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2b0899d2-a250-49c5-9fdf-6a56b777833b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:37.377728 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2b0899d2-a250-49c5-9fdf-6a56b777833b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:37.378187 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2b0899d2-a250-49c5-9fdf-6a56b777833b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:37.378616 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2b0899d2-a250-49c5-9fdf-6a56b777833b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:37.395813 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-878981de-8467-45c8-9269-601ed42ac7e5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:37.403654 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-878981de-8467-45c8-9269-601ed42ac7e5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1322 microversion: 2.1 time: 0.177678 Sep 25 04:36:37.404159 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 52/104] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:37 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:37.439654 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-2b0899d2-a250-49c5-9fdf-6a56b777833b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:37.447232 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-2b0899d2-a250-49c5-9fdf-6a56b777833b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1298 microversion: 2.1 time: 0.081710 Sep 25 04:36:37.447798 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 53/105] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:37 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1298 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:38.247800 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-2f5596de-ee44-426f-83ac-7e82cb0fd8db tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:38.248418 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-2f5596de-ee44-426f-83ac-7e82cb0fd8db tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:38.254458 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2f5596de-ee44-426f-83ac-7e82cb0fd8db tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:38.254935 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2f5596de-ee44-426f-83ac-7e82cb0fd8db tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:38.255367 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2f5596de-ee44-426f-83ac-7e82cb0fd8db tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:38.256042 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2f5596de-ee44-426f-83ac-7e82cb0fd8db tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:38.256490 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2f5596de-ee44-426f-83ac-7e82cb0fd8db tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:38.256933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2f5596de-ee44-426f-83ac-7e82cb0fd8db tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:38.277911 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-ae075e5f-5718-4b10-8f62-4a23c3692033 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:38.279109 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-ae075e5f-5718-4b10-8f62-4a23c3692033 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:38.285529 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ae075e5f-5718-4b10-8f62-4a23c3692033 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:38.285998 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ae075e5f-5718-4b10-8f62-4a23c3692033 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:38.286422 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ae075e5f-5718-4b10-8f62-4a23c3692033 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:38.287021 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ae075e5f-5718-4b10-8f62-4a23c3692033 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:38.287469 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ae075e5f-5718-4b10-8f62-4a23c3692033 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:38.287884 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ae075e5f-5718-4b10-8f62-4a23c3692033 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:38.363154 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-ae075e5f-5718-4b10-8f62-4a23c3692033 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:38.370962 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-ae075e5f-5718-4b10-8f62-4a23c3692033 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1298 microversion: 2.1 time: 0.096774 Sep 25 04:36:38.371594 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 54/106] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:38 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1298 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:36:38.389128 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-a222c116-066a-419d-8f2c-9c0cf431c61d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:38.389862 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-a222c116-066a-419d-8f2c-9c0cf431c61d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:38.395819 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a222c116-066a-419d-8f2c-9c0cf431c61d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:38.396317 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a222c116-066a-419d-8f2c-9c0cf431c61d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:38.396810 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a222c116-066a-419d-8f2c-9c0cf431c61d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:38.397535 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a222c116-066a-419d-8f2c-9c0cf431c61d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:38.397980 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a222c116-066a-419d-8f2c-9c0cf431c61d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:38.398448 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a222c116-066a-419d-8f2c-9c0cf431c61d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:38.424351 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-2f5596de-ee44-426f-83ac-7e82cb0fd8db tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:38.432252 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-2f5596de-ee44-426f-83ac-7e82cb0fd8db tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1314 microversion: 2.1 time: 0.188675 Sep 25 04:36:38.432844 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 53/107] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:38 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:38.437337 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-60bf2e54-4c21-4d61-893c-e3034e4aa219 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:38.437939 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-60bf2e54-4c21-4d61-893c-e3034e4aa219 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:38.443672 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-60bf2e54-4c21-4d61-893c-e3034e4aa219 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:38.444155 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-60bf2e54-4c21-4d61-893c-e3034e4aa219 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:38.444589 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-60bf2e54-4c21-4d61-893c-e3034e4aa219 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:38.445299 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-60bf2e54-4c21-4d61-893c-e3034e4aa219 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:38.446043 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-60bf2e54-4c21-4d61-893c-e3034e4aa219 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:38.446467 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-60bf2e54-4c21-4d61-893c-e3034e4aa219 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:38.460903 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-a222c116-066a-419d-8f2c-9c0cf431c61d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:38.470174 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-a222c116-066a-419d-8f2c-9c0cf431c61d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:38.471648 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-a222c116-066a-419d-8f2c-9c0cf431c61d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:38.473477 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-a222c116-066a-419d-8f2c-9c0cf431c61d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1334 microversion: 2.20 time: 0.087976 Sep 25 04:36:38.473477 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 55/108] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:36:38 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1334 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 04:36:38.478122 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-8d0c5465-7bba-467d-98d0-6bd655b6781b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:38.478776 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-8d0c5465-7bba-467d-98d0-6bd655b6781b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:38.485033 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8d0c5465-7bba-467d-98d0-6bd655b6781b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:38.485849 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8d0c5465-7bba-467d-98d0-6bd655b6781b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:38.486445 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8d0c5465-7bba-467d-98d0-6bd655b6781b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:38.487344 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8d0c5465-7bba-467d-98d0-6bd655b6781b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:38.487946 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8d0c5465-7bba-467d-98d0-6bd655b6781b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:38.488516 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8d0c5465-7bba-467d-98d0-6bd655b6781b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:38.558681 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-8d0c5465-7bba-467d-98d0-6bd655b6781b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:38.566537 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-8d0c5465-7bba-467d-98d0-6bd655b6781b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1298 microversion: 2.1 time: 0.092093 Sep 25 04:36:38.567103 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 56/109] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:38 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1298 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:38.618940 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-60bf2e54-4c21-4d61-893c-e3034e4aa219 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:38.628046 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-60bf2e54-4c21-4d61-893c-e3034e4aa219 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1322 microversion: 2.1 time: 0.194225 Sep 25 04:36:38.628643 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 54/110] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:38 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:39.394634 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-14614821-1efd-4f4e-90f8-8d1bb206a6fd tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:39.395343 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-14614821-1efd-4f4e-90f8-8d1bb206a6fd tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:39.401421 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-14614821-1efd-4f4e-90f8-8d1bb206a6fd tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:39.401913 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-14614821-1efd-4f4e-90f8-8d1bb206a6fd tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:39.402350 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-14614821-1efd-4f4e-90f8-8d1bb206a6fd tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:39.403048 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-14614821-1efd-4f4e-90f8-8d1bb206a6fd tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:39.404107 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-14614821-1efd-4f4e-90f8-8d1bb206a6fd tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:39.404540 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-14614821-1efd-4f4e-90f8-8d1bb206a6fd tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:39.455542 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-cb4b00aa-e924-480e-b34c-7b9d17f021e7 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:39.456174 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-cb4b00aa-e924-480e-b34c-7b9d17f021e7 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:39.462867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cb4b00aa-e924-480e-b34c-7b9d17f021e7 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:39.463356 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cb4b00aa-e924-480e-b34c-7b9d17f021e7 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:39.463784 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cb4b00aa-e924-480e-b34c-7b9d17f021e7 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:39.464862 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cb4b00aa-e924-480e-b34c-7b9d17f021e7 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:39.465477 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cb4b00aa-e924-480e-b34c-7b9d17f021e7 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:39.466381 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cb4b00aa-e924-480e-b34c-7b9d17f021e7 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:39.482584 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-14614821-1efd-4f4e-90f8-8d1bb206a6fd tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:39.491718 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-14614821-1efd-4f4e-90f8-8d1bb206a6fd tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1298 microversion: 2.1 time: 0.100137 Sep 25 04:36:39.493517 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 57/111] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:39 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1298 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:39.498941 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-c30d322d-711b-4d60-82b0-a6aecae12d66 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:39.499546 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-c30d322d-711b-4d60-82b0-a6aecae12d66 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:39.513255 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c30d322d-711b-4d60-82b0-a6aecae12d66 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:39.515466 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c30d322d-711b-4d60-82b0-a6aecae12d66 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:39.516114 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c30d322d-711b-4d60-82b0-a6aecae12d66 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:39.516987 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c30d322d-711b-4d60-82b0-a6aecae12d66 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:39.517447 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c30d322d-711b-4d60-82b0-a6aecae12d66 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:39.517865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c30d322d-711b-4d60-82b0-a6aecae12d66 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:39.548951 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=100 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:39.647629 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-c30d322d-711b-4d60-82b0-a6aecae12d66 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:39.660228 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-c30d322d-711b-4d60-82b0-a6aecae12d66 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:39.665213 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-c30d322d-711b-4d60-82b0-a6aecae12d66 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:39.669998 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-c30d322d-711b-4d60-82b0-a6aecae12d66 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1334 microversion: 2.20 time: 0.175024 Sep 25 04:36:39.670789 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 58/112] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:36:39 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1334 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:36:39.683208 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-44bcc1a8-02b1-4c83-8a5b-b7661167ba06 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:39.683814 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-44bcc1a8-02b1-4c83-8a5b-b7661167ba06 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:39.700708 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-44bcc1a8-02b1-4c83-8a5b-b7661167ba06 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:39.700708 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-44bcc1a8-02b1-4c83-8a5b-b7661167ba06 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:39.700708 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-44bcc1a8-02b1-4c83-8a5b-b7661167ba06 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:39.700708 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-44bcc1a8-02b1-4c83-8a5b-b7661167ba06 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:39.701187 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-44bcc1a8-02b1-4c83-8a5b-b7661167ba06 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:39.701187 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-44bcc1a8-02b1-4c83-8a5b-b7661167ba06 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:39.701340 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-cb4b00aa-e924-480e-b34c-7b9d17f021e7 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:39.704903 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-cb4b00aa-e924-480e-b34c-7b9d17f021e7 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1314 microversion: 2.1 time: 0.253872 Sep 25 04:36:39.706229 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 55/113] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:39 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:39.711165 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-3d25ef05-385f-4b89-8b0c-2dc15c04f5e9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:39.711852 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-3d25ef05-385f-4b89-8b0c-2dc15c04f5e9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:39.718741 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3d25ef05-385f-4b89-8b0c-2dc15c04f5e9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:39.719233 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3d25ef05-385f-4b89-8b0c-2dc15c04f5e9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:39.719668 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3d25ef05-385f-4b89-8b0c-2dc15c04f5e9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:39.720361 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3d25ef05-385f-4b89-8b0c-2dc15c04f5e9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:39.720847 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3d25ef05-385f-4b89-8b0c-2dc15c04f5e9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:39.721430 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3d25ef05-385f-4b89-8b0c-2dc15c04f5e9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:39.799663 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-44bcc1a8-02b1-4c83-8a5b-b7661167ba06 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:39.809924 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-44bcc1a8-02b1-4c83-8a5b-b7661167ba06 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1298 microversion: 2.1 time: 0.138271 Sep 25 04:36:39.810509 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 59/114] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:39 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1298 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:39.909723 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-3d25ef05-385f-4b89-8b0c-2dc15c04f5e9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:39.917458 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-3d25ef05-385f-4b89-8b0c-2dc15c04f5e9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1322 microversion: 2.1 time: 0.210478 Sep 25 04:36:39.918013 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 56/115] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:39 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:40.521527 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-c65c91b2-2cb5-4a38-ae1b-94f9cb1e2e76 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:40.522854 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-c65c91b2-2cb5-4a38-ae1b-94f9cb1e2e76 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:40.531495 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c65c91b2-2cb5-4a38-ae1b-94f9cb1e2e76 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:40.532032 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c65c91b2-2cb5-4a38-ae1b-94f9cb1e2e76 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:40.532904 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c65c91b2-2cb5-4a38-ae1b-94f9cb1e2e76 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:40.535312 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c65c91b2-2cb5-4a38-ae1b-94f9cb1e2e76 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:40.535798 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c65c91b2-2cb5-4a38-ae1b-94f9cb1e2e76 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:40.536217 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c65c91b2-2cb5-4a38-ae1b-94f9cb1e2e76 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:40.675086 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-c65c91b2-2cb5-4a38-ae1b-94f9cb1e2e76 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:40.687548 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-c65c91b2-2cb5-4a38-ae1b-94f9cb1e2e76 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1298 microversion: 2.1 time: 0.170068 Sep 25 04:36:40.689039 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 60/116] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:40 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1298 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:40.708251 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-c258b25b-864f-48a5-8579-4c04cabcb0b8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:40.709730 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-c258b25b-864f-48a5-8579-4c04cabcb0b8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:40.731211 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-a23d2754-8109-433f-9e63-7f574f3f9776 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:40.732334 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-a23d2754-8109-433f-9e63-7f574f3f9776 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:40.733559 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c258b25b-864f-48a5-8579-4c04cabcb0b8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:40.734075 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c258b25b-864f-48a5-8579-4c04cabcb0b8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:40.734513 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c258b25b-864f-48a5-8579-4c04cabcb0b8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:40.735223 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c258b25b-864f-48a5-8579-4c04cabcb0b8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:40.735683 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c258b25b-864f-48a5-8579-4c04cabcb0b8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:40.736107 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c258b25b-864f-48a5-8579-4c04cabcb0b8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:40.745696 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a23d2754-8109-433f-9e63-7f574f3f9776 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:40.746825 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a23d2754-8109-433f-9e63-7f574f3f9776 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:40.747336 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a23d2754-8109-433f-9e63-7f574f3f9776 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:40.751915 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a23d2754-8109-433f-9e63-7f574f3f9776 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:40.754331 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a23d2754-8109-433f-9e63-7f574f3f9776 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:40.756955 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a23d2754-8109-433f-9e63-7f574f3f9776 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:41.266311 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-c258b25b-864f-48a5-8579-4c04cabcb0b8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:41.283239 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-c258b25b-864f-48a5-8579-4c04cabcb0b8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:41.285200 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-c258b25b-864f-48a5-8579-4c04cabcb0b8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:41.286680 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-c258b25b-864f-48a5-8579-4c04cabcb0b8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1334 microversion: 2.20 time: 0.594571 Sep 25 04:36:41.287708 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 57/117] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:36:40 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1334 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:36:41.302242 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-f99b6d80-b22c-4d74-9c2f-d7bd54cd3e3c tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:41.302925 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-f99b6d80-b22c-4d74-9c2f-d7bd54cd3e3c tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:41.314831 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f99b6d80-b22c-4d74-9c2f-d7bd54cd3e3c tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:41.315605 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f99b6d80-b22c-4d74-9c2f-d7bd54cd3e3c tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:41.317921 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f99b6d80-b22c-4d74-9c2f-d7bd54cd3e3c tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:41.318876 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f99b6d80-b22c-4d74-9c2f-d7bd54cd3e3c tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:41.319674 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f99b6d80-b22c-4d74-9c2f-d7bd54cd3e3c tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:41.321034 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f99b6d80-b22c-4d74-9c2f-d7bd54cd3e3c tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:41.373516 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=100 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:41.656620 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-f99b6d80-b22c-4d74-9c2f-d7bd54cd3e3c tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:41.669403 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-f99b6d80-b22c-4d74-9c2f-d7bd54cd3e3c tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1296 microversion: 2.1 time: 0.380302 Sep 25 04:36:41.670100 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 58/118] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:41 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1296 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:41.694304 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-7e4ac443-c60e-4581-a1b3-15195ac82188 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:41.703610 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-7e4ac443-c60e-4581-a1b3-15195ac82188 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:41.715070 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7e4ac443-c60e-4581-a1b3-15195ac82188 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:41.727193 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7e4ac443-c60e-4581-a1b3-15195ac82188 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:41.727802 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7e4ac443-c60e-4581-a1b3-15195ac82188 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:41.730516 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7e4ac443-c60e-4581-a1b3-15195ac82188 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:41.733303 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7e4ac443-c60e-4581-a1b3-15195ac82188 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:41.733970 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7e4ac443-c60e-4581-a1b3-15195ac82188 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:41.939490 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-a23d2754-8109-433f-9e63-7f574f3f9776 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:41.966984 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-a23d2754-8109-433f-9e63-7f574f3f9776 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1314 microversion: 2.1 time: 1.240361 Sep 25 04:36:41.969543 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 61/119] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:40 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1314 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:41.999246 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-b1da3926-3a97-4b03-a564-6f6c227dd624 req-314b034e-98d4-4b6f-8b20-0ffcccc2f8f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4dfff9d-4fc4-4f36-aab0-786607ac2cd2", "name": "network-vif-plugged", "status": "completed", "tag": "f2950532-6a9f-448f-9801-43583bcb904e"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:36:42.014676 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-b1da3926-3a97-4b03-a564-6f6c227dd624 req-314b034e-98d4-4b6f-8b20-0ffcccc2f8f1 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:42.015193 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-b1da3926-3a97-4b03-a564-6f6c227dd624 req-314b034e-98d4-4b6f-8b20-0ffcccc2f8f1 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:42.015740 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-b1da3926-3a97-4b03-a564-6f6c227dd624 req-314b034e-98d4-4b6f-8b20-0ffcccc2f8f1 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:42.055534 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-b1da3926-3a97-4b03-a564-6f6c227dd624 req-314b034e-98d4-4b6f-8b20-0ffcccc2f8f1 service nova] Creating event network-vif-plugged:f2950532-6a9f-448f-9801-43583bcb904e for instance f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 on hv-cinder-85535 Sep 25 04:36:42.066823 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-b1da3926-3a97-4b03-a564-6f6c227dd624 req-314b034e-98d4-4b6f-8b20-0ffcccc2f8f1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095664 Sep 25 04:36:42.068139 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 62/120] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:36:42.078945 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-d2a1c742-eeec-4824-b227-fb8ed70bc852 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:42.079753 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-d2a1c742-eeec-4824-b227-fb8ed70bc852 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:42.087458 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d2a1c742-eeec-4824-b227-fb8ed70bc852 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:42.088158 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d2a1c742-eeec-4824-b227-fb8ed70bc852 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:42.088624 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d2a1c742-eeec-4824-b227-fb8ed70bc852 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:42.089617 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d2a1c742-eeec-4824-b227-fb8ed70bc852 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:42.090191 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d2a1c742-eeec-4824-b227-fb8ed70bc852 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:42.090719 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d2a1c742-eeec-4824-b227-fb8ed70bc852 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:42.212283 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-d2a1c742-eeec-4824-b227-fb8ed70bc852 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:42.226454 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-d2a1c742-eeec-4824-b227-fb8ed70bc852 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1298 microversion: 2.1 time: 0.155938 Sep 25 04:36:42.227528 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 63/121] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:42 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1298 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:42.272095 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-7e4ac443-c60e-4581-a1b3-15195ac82188 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:42.282037 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-7e4ac443-c60e-4581-a1b3-15195ac82188 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1322 microversion: 2.1 time: 0.591891 Sep 25 04:36:42.282616 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 59/122] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:41 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1322 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:42.326970 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-a651f728-c36f-4ecf-af0e-ce4e90bdb047 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:42.328437 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-a651f728-c36f-4ecf-af0e-ce4e90bdb047 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:42.336719 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a651f728-c36f-4ecf-af0e-ce4e90bdb047 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:42.337074 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a651f728-c36f-4ecf-af0e-ce4e90bdb047 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:42.338112 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a651f728-c36f-4ecf-af0e-ce4e90bdb047 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:42.339125 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a651f728-c36f-4ecf-af0e-ce4e90bdb047 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:42.339790 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a651f728-c36f-4ecf-af0e-ce4e90bdb047 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:42.341910 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a651f728-c36f-4ecf-af0e-ce4e90bdb047 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:42.431944 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-a651f728-c36f-4ecf-af0e-ce4e90bdb047 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:42.453478 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-a651f728-c36f-4ecf-af0e-ce4e90bdb047 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:42.455852 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-a651f728-c36f-4ecf-af0e-ce4e90bdb047 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:42.457660 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-a651f728-c36f-4ecf-af0e-ce4e90bdb047 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1340 microversion: 2.20 time: 0.136004 Sep 25 04:36:42.458586 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 64/123] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:36:42 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1340 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:36:42.693897 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-fe6bfd4e-4a08-457a-be6f-131819b95fcb tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:42.694501 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-fe6bfd4e-4a08-457a-be6f-131819b95fcb tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:42.701139 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fe6bfd4e-4a08-457a-be6f-131819b95fcb tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:42.701797 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fe6bfd4e-4a08-457a-be6f-131819b95fcb tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:42.702309 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fe6bfd4e-4a08-457a-be6f-131819b95fcb tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:42.703156 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fe6bfd4e-4a08-457a-be6f-131819b95fcb tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:42.704014 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fe6bfd4e-4a08-457a-be6f-131819b95fcb tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:42.704508 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fe6bfd4e-4a08-457a-be6f-131819b95fcb tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:43.001719 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-a2ca4da2-9775-40c7-8491-97cb9a095cf7 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:43.002510 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-a2ca4da2-9775-40c7-8491-97cb9a095cf7 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:43.012073 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:43.015559 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a2ca4da2-9775-40c7-8491-97cb9a095cf7 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:43.017859 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a2ca4da2-9775-40c7-8491-97cb9a095cf7 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:43.019064 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a2ca4da2-9775-40c7-8491-97cb9a095cf7 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:43.023006 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a2ca4da2-9775-40c7-8491-97cb9a095cf7 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:43.023690 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a2ca4da2-9775-40c7-8491-97cb9a095cf7 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:43.024273 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a2ca4da2-9775-40c7-8491-97cb9a095cf7 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:43.291430 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-fe6bfd4e-4a08-457a-be6f-131819b95fcb tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:43.308194 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-fe6bfd4e-4a08-457a-be6f-131819b95fcb tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1364 microversion: 2.1 time: 0.618726 Sep 25 04:36:43.311722 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 60/124] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:42 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1364 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:43.325100 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-aa078ce7-a5eb-4c4d-b96b-7b890ac23e73 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:43.326059 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-aa078ce7-a5eb-4c4d-b96b-7b890ac23e73 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:43.351678 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-aa078ce7-a5eb-4c4d-b96b-7b890ac23e73 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:43.352183 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-aa078ce7-a5eb-4c4d-b96b-7b890ac23e73 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:43.352617 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-aa078ce7-a5eb-4c4d-b96b-7b890ac23e73 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:43.356806 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-aa078ce7-a5eb-4c4d-b96b-7b890ac23e73 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:43.357534 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-aa078ce7-a5eb-4c4d-b96b-7b890ac23e73 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:43.357985 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-aa078ce7-a5eb-4c4d-b96b-7b890ac23e73 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:43.737792 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-a2ca4da2-9775-40c7-8491-97cb9a095cf7 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:43.749910 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-a2ca4da2-9775-40c7-8491-97cb9a095cf7 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1314 microversion: 2.1 time: 0.753802 Sep 25 04:36:43.753579 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 65/125] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:42 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1314 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:43.767144 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-6beb6d8c-1a55-4f0b-b961-67c5c477d0c9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:43.768007 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-6beb6d8c-1a55-4f0b-b961-67c5c477d0c9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:43.776112 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6beb6d8c-1a55-4f0b-b961-67c5c477d0c9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:43.779041 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6beb6d8c-1a55-4f0b-b961-67c5c477d0c9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:43.779636 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6beb6d8c-1a55-4f0b-b961-67c5c477d0c9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:43.782523 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6beb6d8c-1a55-4f0b-b961-67c5c477d0c9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:43.783011 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6beb6d8c-1a55-4f0b-b961-67c5c477d0c9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:43.786387 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6beb6d8c-1a55-4f0b-b961-67c5c477d0c9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:43.973136 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-aa078ce7-a5eb-4c4d-b96b-7b890ac23e73 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:43.981936 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-aa078ce7-a5eb-4c4d-b96b-7b890ac23e73 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1363 microversion: 2.1 time: 0.667452 Sep 25 04:36:43.998986 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 61/126] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:43 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1363 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:44.004004 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-70338b64-ad75-4f52-b6ee-bcec4f112cde tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:44.004669 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-70338b64-ad75-4f52-b6ee-bcec4f112cde tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:44.017778 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-70338b64-ad75-4f52-b6ee-bcec4f112cde tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:44.024760 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-70338b64-ad75-4f52-b6ee-bcec4f112cde tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:44.026014 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-70338b64-ad75-4f52-b6ee-bcec4f112cde tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:44.032297 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-70338b64-ad75-4f52-b6ee-bcec4f112cde tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:44.033076 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-70338b64-ad75-4f52-b6ee-bcec4f112cde tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:44.033732 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-70338b64-ad75-4f52-b6ee-bcec4f112cde tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:44.272986 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-6beb6d8c-1a55-4f0b-b961-67c5c477d0c9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:44.290576 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-6beb6d8c-1a55-4f0b-b961-67c5c477d0c9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1322 microversion: 2.1 time: 0.535520 Sep 25 04:36:44.292241 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 66/127] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:43 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1322 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:44.311032 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-c1af9f04-3afc-4d9f-afab-d4b8ba576043 req-99475b4f-808a-412b-8e8c-0ff0c5877f14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9be0143-7c91-4fba-8c2c-500f01573632", "tag": "352ac3fb-d005-4e6e-98b0-7339ef6c2202"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:36:44.335672 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-c1af9f04-3afc-4d9f-afab-d4b8ba576043 req-99475b4f-808a-412b-8e8c-0ff0c5877f14 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:44.337413 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-c1af9f04-3afc-4d9f-afab-d4b8ba576043 req-99475b4f-808a-412b-8e8c-0ff0c5877f14 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:44.337858 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-c1af9f04-3afc-4d9f-afab-d4b8ba576043 req-99475b4f-808a-412b-8e8c-0ff0c5877f14 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:44.364848 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-c1af9f04-3afc-4d9f-afab-d4b8ba576043 req-99475b4f-808a-412b-8e8c-0ff0c5877f14 service nova] Creating event network-changed:352ac3fb-d005-4e6e-98b0-7339ef6c2202 for instance c9be0143-7c91-4fba-8c2c-500f01573632 on hv-cinder-85535 Sep 25 04:36:44.370462 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-c1af9f04-3afc-4d9f-afab-d4b8ba576043 req-99475b4f-808a-412b-8e8c-0ff0c5877f14 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076578 Sep 25 04:36:44.371977 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 67/128] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:36:44.380959 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-ad5dd982-6b6e-4c2c-90fa-f12a4e36358c req-12e35af8-9839-414f-981a-cc202860ae66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28c97cc6-73d6-4bf6-9d88-e93dad58e7dc", "name": "network-vif-plugged", "status": "completed", "tag": "3a4f0d9a-e61b-45f0-b1ce-b92f0048c739"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:36:44.393216 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-ad5dd982-6b6e-4c2c-90fa-f12a4e36358c req-12e35af8-9839-414f-981a-cc202860ae66 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:44.394100 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-ad5dd982-6b6e-4c2c-90fa-f12a4e36358c req-12e35af8-9839-414f-981a-cc202860ae66 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:44.395021 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-ad5dd982-6b6e-4c2c-90fa-f12a4e36358c req-12e35af8-9839-414f-981a-cc202860ae66 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:44.407942 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-ad5dd982-6b6e-4c2c-90fa-f12a4e36358c req-12e35af8-9839-414f-981a-cc202860ae66 service nova] Creating event network-vif-plugged:3a4f0d9a-e61b-45f0-b1ce-b92f0048c739 for instance 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc on hv-cinder-85535 Sep 25 04:36:44.413896 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-ad5dd982-6b6e-4c2c-90fa-f12a4e36358c req-12e35af8-9839-414f-981a-cc202860ae66 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039419 Sep 25 04:36:44.414678 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 68/129] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:36:44.421648 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-ece0c791-e1d2-4728-a0a4-13778cc686f4 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:44.422406 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-ece0c791-e1d2-4728-a0a4-13778cc686f4 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:44.431159 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ece0c791-e1d2-4728-a0a4-13778cc686f4 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:44.431880 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ece0c791-e1d2-4728-a0a4-13778cc686f4 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:44.432358 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ece0c791-e1d2-4728-a0a4-13778cc686f4 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:44.433227 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ece0c791-e1d2-4728-a0a4-13778cc686f4 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:44.433792 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ece0c791-e1d2-4728-a0a4-13778cc686f4 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:44.434369 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ece0c791-e1d2-4728-a0a4-13778cc686f4 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:44.470894 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-70338b64-ad75-4f52-b6ee-bcec4f112cde tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:44.486711 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-70338b64-ad75-4f52-b6ee-bcec4f112cde tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:44.488488 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-70338b64-ad75-4f52-b6ee-bcec4f112cde tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:44.490353 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-70338b64-ad75-4f52-b6ee-bcec4f112cde tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1407 microversion: 2.20 time: 0.490338 Sep 25 04:36:44.491496 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 62/130] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:36:43 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1407 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:36:44.775742 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-7c24af67-6580-4a73-b635-48c73c5fc871 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:44.776609 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-7c24af67-6580-4a73-b635-48c73c5fc871 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:44.783942 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7c24af67-6580-4a73-b635-48c73c5fc871 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:44.784699 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7c24af67-6580-4a73-b635-48c73c5fc871 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:44.785308 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7c24af67-6580-4a73-b635-48c73c5fc871 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:44.786163 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7c24af67-6580-4a73-b635-48c73c5fc871 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:44.786764 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7c24af67-6580-4a73-b635-48c73c5fc871 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:44.787331 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7c24af67-6580-4a73-b635-48c73c5fc871 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:44.955613 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-ece0c791-e1d2-4728-a0a4-13778cc686f4 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:44.977204 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-ece0c791-e1d2-4728-a0a4-13778cc686f4 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1364 microversion: 2.1 time: 0.560880 Sep 25 04:36:44.978944 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 69/131] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:44 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1364 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:45.006040 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-675ccff0-d713-40e8-b793-194c8a9513e7 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:45.006960 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-675ccff0-d713-40e8-b793-194c8a9513e7 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:45.015345 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-675ccff0-d713-40e8-b793-194c8a9513e7 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:45.015837 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-675ccff0-d713-40e8-b793-194c8a9513e7 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:45.016560 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-675ccff0-d713-40e8-b793-194c8a9513e7 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:45.020491 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-675ccff0-d713-40e8-b793-194c8a9513e7 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:45.020491 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-675ccff0-d713-40e8-b793-194c8a9513e7 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:45.020491 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-675ccff0-d713-40e8-b793-194c8a9513e7 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:45.226614 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-7c24af67-6580-4a73-b635-48c73c5fc871 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:45.250661 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-7c24af67-6580-4a73-b635-48c73c5fc871 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1314 microversion: 2.1 time: 0.478752 Sep 25 04:36:45.259769 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 63/132] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:44 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1314 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:36:45.316455 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-29bd15a3-740f-445b-818d-97238554a83f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:45.317509 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-29bd15a3-740f-445b-818d-97238554a83f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:45.325810 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-29bd15a3-740f-445b-818d-97238554a83f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:45.331980 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-29bd15a3-740f-445b-818d-97238554a83f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:45.333159 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-29bd15a3-740f-445b-818d-97238554a83f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:45.334268 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-29bd15a3-740f-445b-818d-97238554a83f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:45.335003 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-29bd15a3-740f-445b-818d-97238554a83f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:45.335783 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-29bd15a3-740f-445b-818d-97238554a83f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:45.362014 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-675ccff0-d713-40e8-b793-194c8a9513e7 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:45.372194 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-675ccff0-d713-40e8-b793-194c8a9513e7 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1363 microversion: 2.1 time: 0.370318 Sep 25 04:36:45.396751 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 70/133] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:45 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1363 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:36:45.517272 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-a38d9e29-e573-4441-adb7-5c30e00342c0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:45.520330 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-a38d9e29-e573-4441-adb7-5c30e00342c0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:45.532008 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a38d9e29-e573-4441-adb7-5c30e00342c0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:45.537887 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a38d9e29-e573-4441-adb7-5c30e00342c0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:45.541701 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a38d9e29-e573-4441-adb7-5c30e00342c0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:45.542728 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a38d9e29-e573-4441-adb7-5c30e00342c0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:45.543411 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a38d9e29-e573-4441-adb7-5c30e00342c0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:45.545427 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a38d9e29-e573-4441-adb7-5c30e00342c0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:45.785262 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-29bd15a3-740f-445b-818d-97238554a83f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:45.801849 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-29bd15a3-740f-445b-818d-97238554a83f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1322 microversion: 2.1 time: 0.489863 Sep 25 04:36:45.816663 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 64/134] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:45 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1322 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:36:45.827914 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [req-dddc59cd-1ac2-45f4-96f6-b481d3c6c8a6 req-66ccb625-02d4-4131-a21a-628e37816c41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a31d3c84-7c72-4a2c-970c-b58e15f431f1", "tag": "02bb815d-6dec-4eac-9221-50f10407403b"}]} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:36:45.843214 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-dddc59cd-1ac2-45f4-96f6-b481d3c6c8a6 req-66ccb625-02d4-4131-a21a-628e37816c41 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:45.844228 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-dddc59cd-1ac2-45f4-96f6-b481d3c6c8a6 req-66ccb625-02d4-4131-a21a-628e37816c41 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:45.844966 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-dddc59cd-1ac2-45f4-96f6-b481d3c6c8a6 req-66ccb625-02d4-4131-a21a-628e37816c41 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:45.860767 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.compute.server_external_events [req-dddc59cd-1ac2-45f4-96f6-b481d3c6c8a6 req-66ccb625-02d4-4131-a21a-628e37816c41 service nova] Creating event network-changed:02bb815d-6dec-4eac-9221-50f10407403b for instance a31d3c84-7c72-4a2c-970c-b58e15f431f1 on hv-cinder-85535 Sep 25 04:36:45.868113 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [req-dddc59cd-1ac2-45f4-96f6-b481d3c6c8a6 req-66ccb625-02d4-4131-a21a-628e37816c41 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054180 Sep 25 04:36:45.869538 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 65/135] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:36:45.925005 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-a38d9e29-e573-4441-adb7-5c30e00342c0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:45.934716 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-a38d9e29-e573-4441-adb7-5c30e00342c0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:45.936821 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-a38d9e29-e573-4441-adb7-5c30e00342c0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:45.938106 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-a38d9e29-e573-4441-adb7-5c30e00342c0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1407 microversion: 2.20 time: 0.426051 Sep 25 04:36:45.938808 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 71/136] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:36:45 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1407 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:36:46.007153 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-39552747-3fbc-497d-9c6a-eee8b4300cf0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:46.008001 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-39552747-3fbc-497d-9c6a-eee8b4300cf0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:46.016593 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-39552747-3fbc-497d-9c6a-eee8b4300cf0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:46.017521 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-39552747-3fbc-497d-9c6a-eee8b4300cf0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:46.018093 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-39552747-3fbc-497d-9c6a-eee8b4300cf0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:46.018866 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-39552747-3fbc-497d-9c6a-eee8b4300cf0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:46.019397 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-39552747-3fbc-497d-9c6a-eee8b4300cf0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:46.019910 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-39552747-3fbc-497d-9c6a-eee8b4300cf0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:46.280378 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-b041f6ac-acbd-445e-9164-121af6d1970c tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:46.281502 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-b041f6ac-acbd-445e-9164-121af6d1970c tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:46.288354 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b041f6ac-acbd-445e-9164-121af6d1970c tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:46.288997 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b041f6ac-acbd-445e-9164-121af6d1970c tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:46.290389 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b041f6ac-acbd-445e-9164-121af6d1970c tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:46.291702 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b041f6ac-acbd-445e-9164-121af6d1970c tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:46.292401 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b041f6ac-acbd-445e-9164-121af6d1970c tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:46.293088 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b041f6ac-acbd-445e-9164-121af6d1970c tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:46.710249 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-39552747-3fbc-497d-9c6a-eee8b4300cf0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:46.721997 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-b041f6ac-acbd-445e-9164-121af6d1970c tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:46.727933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-39552747-3fbc-497d-9c6a-eee8b4300cf0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1364 microversion: 2.1 time: 0.726062 Sep 25 04:36:46.728521 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 66/137] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:46 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1364 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:46.735690 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-b041f6ac-acbd-445e-9164-121af6d1970c tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1501 microversion: 2.1 time: 0.461025 Sep 25 04:36:46.737553 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-152c27c8-bd14-4542-a9d9-3de3cc750275 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:46.738383 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-152c27c8-bd14-4542-a9d9-3de3cc750275 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:46.746401 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 72/138] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:46 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1501 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:46.748445 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-152c27c8-bd14-4542-a9d9-3de3cc750275 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:46.749228 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-152c27c8-bd14-4542-a9d9-3de3cc750275 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:46.750099 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-152c27c8-bd14-4542-a9d9-3de3cc750275 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:46.751113 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-bef4d931-64b6-486a-ba86-40d09f974a42 req-99d7458e-091b-494f-826e-463ed832a74d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9e99419-ae76-4d84-9e7a-d0a31530ea14", "tag": "28807ae7-bb46-4e31-93d7-48170864edca"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:36:46.752132 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-152c27c8-bd14-4542-a9d9-3de3cc750275 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:46.752893 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-152c27c8-bd14-4542-a9d9-3de3cc750275 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:46.758187 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-152c27c8-bd14-4542-a9d9-3de3cc750275 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:46.802663 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-bef4d931-64b6-486a-ba86-40d09f974a42 req-99d7458e-091b-494f-826e-463ed832a74d service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:46.803149 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-bef4d931-64b6-486a-ba86-40d09f974a42 req-99d7458e-091b-494f-826e-463ed832a74d service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:46.803577 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-bef4d931-64b6-486a-ba86-40d09f974a42 req-99d7458e-091b-494f-826e-463ed832a74d service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:46.823941 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-bef4d931-64b6-486a-ba86-40d09f974a42 req-99d7458e-091b-494f-826e-463ed832a74d service nova] Creating event network-changed:28807ae7-bb46-4e31-93d7-48170864edca for instance c9e99419-ae76-4d84-9e7a-d0a31530ea14 on hv-cinder-85535 Sep 25 04:36:46.835801 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-bef4d931-64b6-486a-ba86-40d09f974a42 req-99d7458e-091b-494f-826e-463ed832a74d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084818 Sep 25 04:36:46.838371 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 73/139] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:36:46.851651 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-be2701f8-c694-48d7-a34e-e1845b44aae8 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:46.852342 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-be2701f8-c694-48d7-a34e-e1845b44aae8 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:46.868533 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-be2701f8-c694-48d7-a34e-e1845b44aae8 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:46.869840 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-be2701f8-c694-48d7-a34e-e1845b44aae8 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:46.870481 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-be2701f8-c694-48d7-a34e-e1845b44aae8 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:46.871545 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-be2701f8-c694-48d7-a34e-e1845b44aae8 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:46.872251 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-be2701f8-c694-48d7-a34e-e1845b44aae8 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:46.872890 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-be2701f8-c694-48d7-a34e-e1845b44aae8 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:47.317755 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-152c27c8-bd14-4542-a9d9-3de3cc750275 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:47.331962 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-152c27c8-bd14-4542-a9d9-3de3cc750275 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1363 microversion: 2.1 time: 0.597888 Sep 25 04:36:47.336664 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 67/140] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:46 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1363 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:47.357872 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-67c90d9a-8f3c-4aeb-aa3a-fd26b2a8b99a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:47.360820 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-67c90d9a-8f3c-4aeb-aa3a-fd26b2a8b99a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:47.366988 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-be2701f8-c694-48d7-a34e-e1845b44aae8 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:47.369075 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-67c90d9a-8f3c-4aeb-aa3a-fd26b2a8b99a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:47.369730 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-67c90d9a-8f3c-4aeb-aa3a-fd26b2a8b99a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:47.370431 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-67c90d9a-8f3c-4aeb-aa3a-fd26b2a8b99a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:47.371870 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-67c90d9a-8f3c-4aeb-aa3a-fd26b2a8b99a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:47.373566 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-67c90d9a-8f3c-4aeb-aa3a-fd26b2a8b99a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:47.374306 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-67c90d9a-8f3c-4aeb-aa3a-fd26b2a8b99a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:47.375599 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-be2701f8-c694-48d7-a34e-e1845b44aae8 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1322 microversion: 2.1 time: 0.532585 Sep 25 04:36:47.376171 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 74/141] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:46 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1322 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:47.546276 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-67c90d9a-8f3c-4aeb-aa3a-fd26b2a8b99a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:47.563706 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-67c90d9a-8f3c-4aeb-aa3a-fd26b2a8b99a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:47.567883 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-67c90d9a-8f3c-4aeb-aa3a-fd26b2a8b99a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:47.570260 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-67c90d9a-8f3c-4aeb-aa3a-fd26b2a8b99a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1407 microversion: 2.20 time: 0.232105 Sep 25 04:36:47.588749 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 68/142] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:36:47 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:36:47.753245 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-015ac47c-a0fb-40b1-b5da-49fe4abbd793 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:47.754432 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-015ac47c-a0fb-40b1-b5da-49fe4abbd793 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:47.769481 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-015ac47c-a0fb-40b1-b5da-49fe4abbd793 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:47.771442 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-015ac47c-a0fb-40b1-b5da-49fe4abbd793 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:47.773024 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-015ac47c-a0fb-40b1-b5da-49fe4abbd793 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:47.773762 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-015ac47c-a0fb-40b1-b5da-49fe4abbd793 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:47.774219 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-015ac47c-a0fb-40b1-b5da-49fe4abbd793 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:47.774645 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-015ac47c-a0fb-40b1-b5da-49fe4abbd793 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:48.199689 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-015ac47c-a0fb-40b1-b5da-49fe4abbd793 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:48.208893 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-015ac47c-a0fb-40b1-b5da-49fe4abbd793 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1364 microversion: 2.1 time: 0.459916 Sep 25 04:36:48.221942 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 75/143] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:47 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1364 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:48.317389 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-b1dce5f6-ab2d-4a76-a14c-517ecfedcdfd tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b55fcddb-0378-492f-9192-f9dd52d386e1"}} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:36:48.320041 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-b1dce5f6-ab2d-4a76-a14c-517ecfedcdfd tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:48.326111 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_api:SELECT=100 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:48.328019 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b1dce5f6-ab2d-4a76-a14c-517ecfedcdfd tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:48.329033 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b1dce5f6-ab2d-4a76-a14c-517ecfedcdfd tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:48.329743 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b1dce5f6-ab2d-4a76-a14c-517ecfedcdfd tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:48.330703 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b1dce5f6-ab2d-4a76-a14c-517ecfedcdfd tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:48.331451 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b1dce5f6-ab2d-4a76-a14c-517ecfedcdfd tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:48.332099 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b1dce5f6-ab2d-4a76-a14c-517ecfedcdfd tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:48.359342 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-18f02c6b-c4f7-4e07-9795-399c6c1f4fae tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:48.359946 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-18f02c6b-c4f7-4e07-9795-399c6c1f4fae tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:48.369489 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-18f02c6b-c4f7-4e07-9795-399c6c1f4fae tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:48.369908 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-18f02c6b-c4f7-4e07-9795-399c6c1f4fae tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:48.370353 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-18f02c6b-c4f7-4e07-9795-399c6c1f4fae tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:48.371038 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-18f02c6b-c4f7-4e07-9795-399c6c1f4fae tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:48.371498 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-18f02c6b-c4f7-4e07-9795-399c6c1f4fae tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:48.371948 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-18f02c6b-c4f7-4e07-9795-399c6c1f4fae tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:48.613151 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-18f02c6b-c4f7-4e07-9795-399c6c1f4fae tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:48.624737 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-18f02c6b-c4f7-4e07-9795-399c6c1f4fae tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1363 microversion: 2.1 time: 0.269132 Sep 25 04:36:48.626593 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 76/144] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:48 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1363 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:36:48.633094 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-fa7be294-0d70-4c52-ab57-c174bf90b333 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:48.634231 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-fa7be294-0d70-4c52-ab57-c174bf90b333 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:48.642618 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fa7be294-0d70-4c52-ab57-c174bf90b333 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:48.643099 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fa7be294-0d70-4c52-ab57-c174bf90b333 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:48.643522 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fa7be294-0d70-4c52-ab57-c174bf90b333 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:48.644379 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fa7be294-0d70-4c52-ab57-c174bf90b333 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:48.644985 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fa7be294-0d70-4c52-ab57-c174bf90b333 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:48.645512 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fa7be294-0d70-4c52-ab57-c174bf90b333 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:48.813532 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-fa7be294-0d70-4c52-ab57-c174bf90b333 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:48.817855 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=100 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:48.823434 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-fa7be294-0d70-4c52-ab57-c174bf90b333 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1322 microversion: 2.1 time: 0.195843 Sep 25 04:36:48.824573 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 77/145] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:48 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:48.830336 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-b66ab607-361a-44de-9b35-b3aa500b65fc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:48.831185 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-b66ab607-361a-44de-9b35-b3aa500b65fc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:48.838084 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b66ab607-361a-44de-9b35-b3aa500b65fc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:48.838659 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b66ab607-361a-44de-9b35-b3aa500b65fc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:48.839158 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b66ab607-361a-44de-9b35-b3aa500b65fc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:48.840001 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b66ab607-361a-44de-9b35-b3aa500b65fc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:48.840506 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b66ab607-361a-44de-9b35-b3aa500b65fc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:48.841510 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b66ab607-361a-44de-9b35-b3aa500b65fc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:48.989898 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-b66ab607-361a-44de-9b35-b3aa500b65fc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:48.998592 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-b66ab607-361a-44de-9b35-b3aa500b65fc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:49.000157 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-b66ab607-361a-44de-9b35-b3aa500b65fc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:49.001369 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-b66ab607-361a-44de-9b35-b3aa500b65fc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1407 microversion: 2.20 time: 0.175085 Sep 25 04:36:49.002332 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 78/146] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:36:48 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:36:49.235721 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-f8b0cfe7-04b5-439c-8929-da4a2762e6b4 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:49.236325 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-f8b0cfe7-04b5-439c-8929-da4a2762e6b4 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:49.244913 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f8b0cfe7-04b5-439c-8929-da4a2762e6b4 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:49.245403 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f8b0cfe7-04b5-439c-8929-da4a2762e6b4 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:49.245831 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f8b0cfe7-04b5-439c-8929-da4a2762e6b4 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:49.247272 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f8b0cfe7-04b5-439c-8929-da4a2762e6b4 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:49.247823 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f8b0cfe7-04b5-439c-8929-da4a2762e6b4 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:49.248608 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f8b0cfe7-04b5-439c-8929-da4a2762e6b4 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:49.417419 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-f8b0cfe7-04b5-439c-8929-da4a2762e6b4 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:49.426439 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-f8b0cfe7-04b5-439c-8929-da4a2762e6b4 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1364 microversion: 2.1 time: 0.195624 Sep 25 04:36:49.427177 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 79/147] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:49 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1364 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:36:49.649027 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-5bdb9890-7242-4fb5-8bf1-a84a16c4c44f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:49.649662 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-5bdb9890-7242-4fb5-8bf1-a84a16c4c44f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:49.657846 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5bdb9890-7242-4fb5-8bf1-a84a16c4c44f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:49.658597 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5bdb9890-7242-4fb5-8bf1-a84a16c4c44f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:49.659248 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5bdb9890-7242-4fb5-8bf1-a84a16c4c44f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:49.660131 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5bdb9890-7242-4fb5-8bf1-a84a16c4c44f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:49.660905 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5bdb9890-7242-4fb5-8bf1-a84a16c4c44f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:49.661519 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5bdb9890-7242-4fb5-8bf1-a84a16c4c44f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:49.891613 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-5bdb9890-7242-4fb5-8bf1-a84a16c4c44f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:49.907712 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-5bdb9890-7242-4fb5-8bf1-a84a16c4c44f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1363 microversion: 2.1 time: 0.263836 Sep 25 04:36:49.908404 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 80/148] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:49 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1363 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:49.924450 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-1984623c-587c-4189-9734-fbc17231fb9b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:49.925295 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-1984623c-587c-4189-9734-fbc17231fb9b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:49.931383 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1984623c-587c-4189-9734-fbc17231fb9b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:49.932077 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1984623c-587c-4189-9734-fbc17231fb9b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:49.932736 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1984623c-587c-4189-9734-fbc17231fb9b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:49.933608 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1984623c-587c-4189-9734-fbc17231fb9b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:49.934847 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1984623c-587c-4189-9734-fbc17231fb9b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:49.935674 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1984623c-587c-4189-9734-fbc17231fb9b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:50.096799 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-1984623c-587c-4189-9734-fbc17231fb9b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:50.106651 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-1984623c-587c-4189-9734-fbc17231fb9b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1322 microversion: 2.1 time: 0.196690 Sep 25 04:36:50.108116 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 81/149] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:49 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:50.113294 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-f65b09ca-4f1d-497a-8896-0fa7564f45f9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:50.114040 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-f65b09ca-4f1d-497a-8896-0fa7564f45f9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:50.120020 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f65b09ca-4f1d-497a-8896-0fa7564f45f9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:50.120494 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f65b09ca-4f1d-497a-8896-0fa7564f45f9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:50.120969 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f65b09ca-4f1d-497a-8896-0fa7564f45f9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:50.122653 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f65b09ca-4f1d-497a-8896-0fa7564f45f9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:50.123638 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f65b09ca-4f1d-497a-8896-0fa7564f45f9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:50.124370 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f65b09ca-4f1d-497a-8896-0fa7564f45f9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:50.383852 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-f65b09ca-4f1d-497a-8896-0fa7564f45f9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:50.393931 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-f65b09ca-4f1d-497a-8896-0fa7564f45f9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:50.395703 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-f65b09ca-4f1d-497a-8896-0fa7564f45f9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:50.397286 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-f65b09ca-4f1d-497a-8896-0fa7564f45f9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1407 microversion: 2.20 time: 0.287788 Sep 25 04:36:50.398057 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 82/150] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:36:50 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1407 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:36:50.452590 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-ce08c2cc-ee73-49ba-9ffb-35e9eebf7438 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:50.453343 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-ce08c2cc-ee73-49ba-9ffb-35e9eebf7438 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:50.461191 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ce08c2cc-ee73-49ba-9ffb-35e9eebf7438 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:50.461975 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ce08c2cc-ee73-49ba-9ffb-35e9eebf7438 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:50.462419 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ce08c2cc-ee73-49ba-9ffb-35e9eebf7438 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:50.463624 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ce08c2cc-ee73-49ba-9ffb-35e9eebf7438 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:50.464483 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ce08c2cc-ee73-49ba-9ffb-35e9eebf7438 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:50.466288 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ce08c2cc-ee73-49ba-9ffb-35e9eebf7438 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:50.628670 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-ce08c2cc-ee73-49ba-9ffb-35e9eebf7438 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:50.636385 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-ce08c2cc-ee73-49ba-9ffb-35e9eebf7438 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1364 microversion: 2.1 time: 0.189807 Sep 25 04:36:50.638163 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 83/151] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:50 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1364 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:36:50.933759 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-87c0ee1a-aaf4-4307-8a3c-a0d80d2ba1c8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:50.935555 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-87c0ee1a-aaf4-4307-8a3c-a0d80d2ba1c8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:50.943119 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-87c0ee1a-aaf4-4307-8a3c-a0d80d2ba1c8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:50.944211 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-87c0ee1a-aaf4-4307-8a3c-a0d80d2ba1c8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:50.945332 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-87c0ee1a-aaf4-4307-8a3c-a0d80d2ba1c8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:50.946612 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-87c0ee1a-aaf4-4307-8a3c-a0d80d2ba1c8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:50.947272 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-87c0ee1a-aaf4-4307-8a3c-a0d80d2ba1c8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:50.948241 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-87c0ee1a-aaf4-4307-8a3c-a0d80d2ba1c8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:51.141946 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-87c0ee1a-aaf4-4307-8a3c-a0d80d2ba1c8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:51.155766 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-87c0ee1a-aaf4-4307-8a3c-a0d80d2ba1c8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1363 microversion: 2.1 time: 0.226672 Sep 25 04:36:51.173212 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 84/152] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:50 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:51.180163 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-8b0d9bb7-b1b5-477c-b8ab-ba04bd52bf6b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:51.181576 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-8b0d9bb7-b1b5-477c-b8ab-ba04bd52bf6b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:51.189134 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8b0d9bb7-b1b5-477c-b8ab-ba04bd52bf6b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:51.189755 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8b0d9bb7-b1b5-477c-b8ab-ba04bd52bf6b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:51.190226 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8b0d9bb7-b1b5-477c-b8ab-ba04bd52bf6b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:51.190913 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8b0d9bb7-b1b5-477c-b8ab-ba04bd52bf6b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:51.191725 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8b0d9bb7-b1b5-477c-b8ab-ba04bd52bf6b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:51.192168 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8b0d9bb7-b1b5-477c-b8ab-ba04bd52bf6b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:51.402143 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-8b0d9bb7-b1b5-477c-b8ab-ba04bd52bf6b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:51.413461 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-8b0d9bb7-b1b5-477c-b8ab-ba04bd52bf6b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1517 microversion: 2.1 time: 0.238858 Sep 25 04:36:51.414243 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 85/153] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:51 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1517 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:51.430875 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-f37abfa0-67c4-4115-844c-f1ccdf482342 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:51.431965 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-f37abfa0-67c4-4115-844c-f1ccdf482342 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:51.440966 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f37abfa0-67c4-4115-844c-f1ccdf482342 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:51.441795 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f37abfa0-67c4-4115-844c-f1ccdf482342 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:51.443310 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f37abfa0-67c4-4115-844c-f1ccdf482342 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:51.444284 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f37abfa0-67c4-4115-844c-f1ccdf482342 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:51.445855 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f37abfa0-67c4-4115-844c-f1ccdf482342 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:51.446667 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f37abfa0-67c4-4115-844c-f1ccdf482342 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:51.678898 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-f37abfa0-67c4-4115-844c-f1ccdf482342 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:51.689584 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-f37abfa0-67c4-4115-844c-f1ccdf482342 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:51.691038 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-f37abfa0-67c4-4115-844c-f1ccdf482342 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:51.692156 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-f37abfa0-67c4-4115-844c-f1ccdf482342 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1407 microversion: 2.20 time: 0.270643 Sep 25 04:36:51.692730 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 86/154] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:36:51 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1407 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 04:36:51.698275 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-fb8d36a2-a368-4195-8020-db80ca110202 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:36:51.701576 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-fb8d36a2-a368-4195-8020-db80ca110202 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:51.708214 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fb8d36a2-a368-4195-8020-db80ca110202 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:51.708832 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fb8d36a2-a368-4195-8020-db80ca110202 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:51.709486 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fb8d36a2-a368-4195-8020-db80ca110202 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:51.710534 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fb8d36a2-a368-4195-8020-db80ca110202 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:51.710991 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fb8d36a2-a368-4195-8020-db80ca110202 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:51.711410 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fb8d36a2-a368-4195-8020-db80ca110202 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:51.775791 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.objects.instance [None req-fb8d36a2-a368-4195-8020-db80ca110202 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lazy-loading 'flavor' on Instance uuid 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc {{(pid=127142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 04:36:51.905312 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-fb8d36a2-a368-4195-8020-db80ca110202 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "POST /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc/action" status: 200 len: 32 microversion: 2.1 time: 0.210651 Sep 25 04:36:51.906328 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 87/155] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 25 04:36:51 2022] POST /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc/action => generated 32 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 04:36:51.911836 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-793cc7a9-17ba-4306-8300-bb91c320c59a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:51.912518 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-793cc7a9-17ba-4306-8300-bb91c320c59a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:51.921058 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-793cc7a9-17ba-4306-8300-bb91c320c59a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:51.921540 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-793cc7a9-17ba-4306-8300-bb91c320c59a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:51.921966 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-793cc7a9-17ba-4306-8300-bb91c320c59a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:51.922737 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-793cc7a9-17ba-4306-8300-bb91c320c59a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:51.923094 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-793cc7a9-17ba-4306-8300-bb91c320c59a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:51.923511 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-793cc7a9-17ba-4306-8300-bb91c320c59a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:52.082669 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-793cc7a9-17ba-4306-8300-bb91c320c59a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:52.091782 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-793cc7a9-17ba-4306-8300-bb91c320c59a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1364 microversion: 2.1 time: 0.184065 Sep 25 04:36:52.092354 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 88/156] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:51 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:52.097459 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-fdfbc497-04ad-481d-8517-d4fa0b0a80cf tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:52.098353 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-fdfbc497-04ad-481d-8517-d4fa0b0a80cf tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:52.105400 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fdfbc497-04ad-481d-8517-d4fa0b0a80cf tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:52.105874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fdfbc497-04ad-481d-8517-d4fa0b0a80cf tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:52.107035 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fdfbc497-04ad-481d-8517-d4fa0b0a80cf tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:52.108266 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fdfbc497-04ad-481d-8517-d4fa0b0a80cf tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:52.109772 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fdfbc497-04ad-481d-8517-d4fa0b0a80cf tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:52.110506 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fdfbc497-04ad-481d-8517-d4fa0b0a80cf tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:52.260675 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-fdfbc497-04ad-481d-8517-d4fa0b0a80cf tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:52.271037 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-fdfbc497-04ad-481d-8517-d4fa0b0a80cf tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.176984 Sep 25 04:36:52.272259 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 89/157] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:52 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:52.276974 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-bbe6341a-afac-42cb-9b8f-b5bddfac3369 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:52.277571 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-bbe6341a-afac-42cb-9b8f-b5bddfac3369 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:52.284077 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bbe6341a-afac-42cb-9b8f-b5bddfac3369 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:52.284561 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bbe6341a-afac-42cb-9b8f-b5bddfac3369 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:52.285041 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bbe6341a-afac-42cb-9b8f-b5bddfac3369 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:52.285901 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bbe6341a-afac-42cb-9b8f-b5bddfac3369 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:52.286379 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bbe6341a-afac-42cb-9b8f-b5bddfac3369 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:52.286974 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bbe6341a-afac-42cb-9b8f-b5bddfac3369 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:52.483974 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-bbe6341a-afac-42cb-9b8f-b5bddfac3369 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:52.492523 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-bbe6341a-afac-42cb-9b8f-b5bddfac3369 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1363 microversion: 2.1 time: 0.218995 Sep 25 04:36:52.493124 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 90/158] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:52 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:52.719706 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-a79463a3-25b9-41bf-a118-7ba941ea69fb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:52.720419 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-a79463a3-25b9-41bf-a118-7ba941ea69fb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:52.727282 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a79463a3-25b9-41bf-a118-7ba941ea69fb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:52.728013 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a79463a3-25b9-41bf-a118-7ba941ea69fb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:52.728690 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a79463a3-25b9-41bf-a118-7ba941ea69fb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:52.729594 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a79463a3-25b9-41bf-a118-7ba941ea69fb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:52.730252 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a79463a3-25b9-41bf-a118-7ba941ea69fb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:52.730879 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a79463a3-25b9-41bf-a118-7ba941ea69fb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:52.877747 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-a79463a3-25b9-41bf-a118-7ba941ea69fb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:52.886086 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-a79463a3-25b9-41bf-a118-7ba941ea69fb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:52.888394 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-a79463a3-25b9-41bf-a118-7ba941ea69fb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:52.889553 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-a79463a3-25b9-41bf-a118-7ba941ea69fb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1407 microversion: 2.20 time: 0.174573 Sep 25 04:36:52.905126 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 91/159] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:36:52 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:36:53.115192 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-d57cc9d8-fca7-437a-af7c-9fb754d4769d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:53.115824 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-d57cc9d8-fca7-437a-af7c-9fb754d4769d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:53.123208 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d57cc9d8-fca7-437a-af7c-9fb754d4769d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:53.123656 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d57cc9d8-fca7-437a-af7c-9fb754d4769d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:53.124040 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d57cc9d8-fca7-437a-af7c-9fb754d4769d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:53.124746 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d57cc9d8-fca7-437a-af7c-9fb754d4769d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:53.125368 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d57cc9d8-fca7-437a-af7c-9fb754d4769d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:53.125794 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d57cc9d8-fca7-437a-af7c-9fb754d4769d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:53.145070 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:53.301871 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-d57cc9d8-fca7-437a-af7c-9fb754d4769d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:53.309501 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-d57cc9d8-fca7-437a-af7c-9fb754d4769d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1364 microversion: 2.1 time: 0.198005 Sep 25 04:36:53.310402 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 92/160] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:53 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1364 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:53.314873 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-eb4d0e04-aaea-43fc-a80f-4dbd51d1f19f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:53.315672 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-eb4d0e04-aaea-43fc-a80f-4dbd51d1f19f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:53.322179 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-eb4d0e04-aaea-43fc-a80f-4dbd51d1f19f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:53.322882 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-eb4d0e04-aaea-43fc-a80f-4dbd51d1f19f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:53.323503 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-eb4d0e04-aaea-43fc-a80f-4dbd51d1f19f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:53.324371 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-eb4d0e04-aaea-43fc-a80f-4dbd51d1f19f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:53.325537 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-eb4d0e04-aaea-43fc-a80f-4dbd51d1f19f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:53.326360 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-eb4d0e04-aaea-43fc-a80f-4dbd51d1f19f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:53.480387 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-eb4d0e04-aaea-43fc-a80f-4dbd51d1f19f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:53.492206 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-eb4d0e04-aaea-43fc-a80f-4dbd51d1f19f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.180705 Sep 25 04:36:53.492940 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 93/161] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:53 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:53.518153 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-1d00d3ad-c48f-4caa-b7bc-4e928047488e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:53.518761 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-1d00d3ad-c48f-4caa-b7bc-4e928047488e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:53.524888 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1d00d3ad-c48f-4caa-b7bc-4e928047488e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:53.526202 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1d00d3ad-c48f-4caa-b7bc-4e928047488e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:53.526811 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1d00d3ad-c48f-4caa-b7bc-4e928047488e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:53.527669 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1d00d3ad-c48f-4caa-b7bc-4e928047488e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:53.528483 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1d00d3ad-c48f-4caa-b7bc-4e928047488e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:53.529214 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1d00d3ad-c48f-4caa-b7bc-4e928047488e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:53.670647 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-1d00d3ad-c48f-4caa-b7bc-4e928047488e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:53.678206 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-1d00d3ad-c48f-4caa-b7bc-4e928047488e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1363 microversion: 2.1 time: 0.166811 Sep 25 04:36:53.678987 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 94/162] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:53 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:36:53.917151 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-716a81b9-7e11-4e99-8602-53913b9c3574 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:53.917890 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-716a81b9-7e11-4e99-8602-53913b9c3574 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:53.926219 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-716a81b9-7e11-4e99-8602-53913b9c3574 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:53.927103 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-716a81b9-7e11-4e99-8602-53913b9c3574 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:53.927797 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-716a81b9-7e11-4e99-8602-53913b9c3574 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:53.928569 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-716a81b9-7e11-4e99-8602-53913b9c3574 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:53.929226 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-716a81b9-7e11-4e99-8602-53913b9c3574 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:53.929825 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-716a81b9-7e11-4e99-8602-53913b9c3574 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:54.152417 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-716a81b9-7e11-4e99-8602-53913b9c3574 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:54.180741 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-716a81b9-7e11-4e99-8602-53913b9c3574 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:54.185683 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-716a81b9-7e11-4e99-8602-53913b9c3574 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:54.189239 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-716a81b9-7e11-4e99-8602-53913b9c3574 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1407 microversion: 2.20 time: 0.275994 Sep 25 04:36:54.190777 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 95/163] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:36:53 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 04:36:54.337321 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-ab680d20-d181-4c52-bf31-85f4000dfbcd tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:54.338119 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-ab680d20-d181-4c52-bf31-85f4000dfbcd tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:54.345482 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ab680d20-d181-4c52-bf31-85f4000dfbcd tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:54.346128 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ab680d20-d181-4c52-bf31-85f4000dfbcd tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:54.346725 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ab680d20-d181-4c52-bf31-85f4000dfbcd tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:54.347573 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ab680d20-d181-4c52-bf31-85f4000dfbcd tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:54.348174 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ab680d20-d181-4c52-bf31-85f4000dfbcd tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:54.348944 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ab680d20-d181-4c52-bf31-85f4000dfbcd tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:54.498085 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-ab680d20-d181-4c52-bf31-85f4000dfbcd tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:54.507556 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-ab680d20-d181-4c52-bf31-85f4000dfbcd tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1364 microversion: 2.1 time: 0.173972 Sep 25 04:36:54.508605 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 96/164] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:54 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:36:54.517306 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-77e4dd2f-5213-4975-8fd8-996312c126d2 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:54.518169 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-77e4dd2f-5213-4975-8fd8-996312c126d2 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:54.524220 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-77e4dd2f-5213-4975-8fd8-996312c126d2 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:54.524835 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-77e4dd2f-5213-4975-8fd8-996312c126d2 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:54.525473 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-77e4dd2f-5213-4975-8fd8-996312c126d2 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:54.526251 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-77e4dd2f-5213-4975-8fd8-996312c126d2 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:54.526893 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-77e4dd2f-5213-4975-8fd8-996312c126d2 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:54.527653 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-77e4dd2f-5213-4975-8fd8-996312c126d2 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:54.672361 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-77e4dd2f-5213-4975-8fd8-996312c126d2 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:54.679977 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-77e4dd2f-5213-4975-8fd8-996312c126d2 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.166401 Sep 25 04:36:54.681018 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 97/165] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:54 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:54.701267 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-2b443602-4229-4961-84cd-1294d5217832 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:54.701865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-2b443602-4229-4961-84cd-1294d5217832 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:54.707831 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2b443602-4229-4961-84cd-1294d5217832 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:54.708305 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2b443602-4229-4961-84cd-1294d5217832 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:54.708776 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2b443602-4229-4961-84cd-1294d5217832 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:54.709452 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2b443602-4229-4961-84cd-1294d5217832 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:54.709893 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2b443602-4229-4961-84cd-1294d5217832 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:54.710307 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2b443602-4229-4961-84cd-1294d5217832 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:54.844993 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-2b443602-4229-4961-84cd-1294d5217832 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:54.855754 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-2b443602-4229-4961-84cd-1294d5217832 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1363 microversion: 2.1 time: 0.155178 Sep 25 04:36:54.855754 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 98/166] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:54 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:55.217241 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-0ac61c59-5c92-4cd4-ac34-7bf5945f3424 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:55.217897 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-0ac61c59-5c92-4cd4-ac34-7bf5945f3424 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:55.224085 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0ac61c59-5c92-4cd4-ac34-7bf5945f3424 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:55.224566 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0ac61c59-5c92-4cd4-ac34-7bf5945f3424 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:55.225010 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0ac61c59-5c92-4cd4-ac34-7bf5945f3424 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:55.225683 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0ac61c59-5c92-4cd4-ac34-7bf5945f3424 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:55.226129 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0ac61c59-5c92-4cd4-ac34-7bf5945f3424 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:55.226544 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0ac61c59-5c92-4cd4-ac34-7bf5945f3424 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:55.372238 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-0ac61c59-5c92-4cd4-ac34-7bf5945f3424 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:55.380822 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-0ac61c59-5c92-4cd4-ac34-7bf5945f3424 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:55.382448 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-0ac61c59-5c92-4cd4-ac34-7bf5945f3424 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:55.383546 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-0ac61c59-5c92-4cd4-ac34-7bf5945f3424 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1407 microversion: 2.20 time: 0.171007 Sep 25 04:36:55.384096 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 99/167] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:36:55 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 04:36:55.531288 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-456d3848-d742-4f6b-9ca1-ece8a3f673e6 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:55.532123 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-456d3848-d742-4f6b-9ca1-ece8a3f673e6 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:55.538356 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-456d3848-d742-4f6b-9ca1-ece8a3f673e6 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:55.538849 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-456d3848-d742-4f6b-9ca1-ece8a3f673e6 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:55.539286 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-456d3848-d742-4f6b-9ca1-ece8a3f673e6 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:55.540161 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-456d3848-d742-4f6b-9ca1-ece8a3f673e6 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:55.540986 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-456d3848-d742-4f6b-9ca1-ece8a3f673e6 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:55.541426 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-456d3848-d742-4f6b-9ca1-ece8a3f673e6 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:55.717218 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-456d3848-d742-4f6b-9ca1-ece8a3f673e6 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:55.724945 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-456d3848-d742-4f6b-9ca1-ece8a3f673e6 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1364 microversion: 2.1 time: 0.197423 Sep 25 04:36:55.725509 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 100/168] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:55 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1364 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:36:55.743028 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-3096763c-3316-4fbc-9221-c39b2462649f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:55.744110 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-3096763c-3316-4fbc-9221-c39b2462649f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:55.750881 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3096763c-3316-4fbc-9221-c39b2462649f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:55.751363 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3096763c-3316-4fbc-9221-c39b2462649f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:55.751816 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3096763c-3316-4fbc-9221-c39b2462649f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:55.752498 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3096763c-3316-4fbc-9221-c39b2462649f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:55.753056 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3096763c-3316-4fbc-9221-c39b2462649f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:55.753482 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3096763c-3316-4fbc-9221-c39b2462649f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:55.898689 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-3096763c-3316-4fbc-9221-c39b2462649f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:55.907762 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-3096763c-3316-4fbc-9221-c39b2462649f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.169367 Sep 25 04:36:55.908450 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 101/169] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:55 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:55.913622 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-b961c6df-c8dd-41de-9615-3746d67aedb9 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:55.914311 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-b961c6df-c8dd-41de-9615-3746d67aedb9 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:55.921460 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b961c6df-c8dd-41de-9615-3746d67aedb9 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:55.922349 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b961c6df-c8dd-41de-9615-3746d67aedb9 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:55.922978 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b961c6df-c8dd-41de-9615-3746d67aedb9 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:55.923895 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b961c6df-c8dd-41de-9615-3746d67aedb9 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:55.924615 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b961c6df-c8dd-41de-9615-3746d67aedb9 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:55.925470 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b961c6df-c8dd-41de-9615-3746d67aedb9 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:56.074290 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-b961c6df-c8dd-41de-9615-3746d67aedb9 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:56.084694 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-b961c6df-c8dd-41de-9615-3746d67aedb9 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1363 microversion: 2.1 time: 0.173742 Sep 25 04:36:56.084861 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 102/170] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:55 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:56.411937 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-f7df6d74-e1c4-48af-878a-d509070ce61f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:56.413097 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-f7df6d74-e1c4-48af-878a-d509070ce61f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:56.419789 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f7df6d74-e1c4-48af-878a-d509070ce61f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:56.420272 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f7df6d74-e1c4-48af-878a-d509070ce61f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:56.420933 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f7df6d74-e1c4-48af-878a-d509070ce61f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:56.421629 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f7df6d74-e1c4-48af-878a-d509070ce61f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:56.422079 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f7df6d74-e1c4-48af-878a-d509070ce61f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:56.422494 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f7df6d74-e1c4-48af-878a-d509070ce61f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:56.583943 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-f7df6d74-e1c4-48af-878a-d509070ce61f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:56.592430 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-f7df6d74-e1c4-48af-878a-d509070ce61f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:56.594353 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-f7df6d74-e1c4-48af-878a-d509070ce61f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:56.595984 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-f7df6d74-e1c4-48af-878a-d509070ce61f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1407 microversion: 2.20 time: 0.190055 Sep 25 04:36:56.625809 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 103/171] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:36:56 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 04:36:56.755621 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-a3327630-baf7-47ad-9e92-1cf7ac7ef4ac tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:56.756283 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-a3327630-baf7-47ad-9e92-1cf7ac7ef4ac tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:56.765304 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a3327630-baf7-47ad-9e92-1cf7ac7ef4ac tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:56.766119 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a3327630-baf7-47ad-9e92-1cf7ac7ef4ac tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:56.766554 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a3327630-baf7-47ad-9e92-1cf7ac7ef4ac tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:56.767255 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a3327630-baf7-47ad-9e92-1cf7ac7ef4ac tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:56.767740 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a3327630-baf7-47ad-9e92-1cf7ac7ef4ac tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:56.768316 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a3327630-baf7-47ad-9e92-1cf7ac7ef4ac tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:56.922118 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-a3327630-baf7-47ad-9e92-1cf7ac7ef4ac tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:56.933776 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-a3327630-baf7-47ad-9e92-1cf7ac7ef4ac tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1364 microversion: 2.1 time: 0.184103 Sep 25 04:36:56.934853 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 104/172] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:56 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:36:56.939994 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-eac8d8d7-5691-4c87-8740-9405455cd5b4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:56.940762 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-eac8d8d7-5691-4c87-8740-9405455cd5b4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:56.948386 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-eac8d8d7-5691-4c87-8740-9405455cd5b4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:56.949002 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-eac8d8d7-5691-4c87-8740-9405455cd5b4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:56.949922 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-eac8d8d7-5691-4c87-8740-9405455cd5b4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:56.951011 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-eac8d8d7-5691-4c87-8740-9405455cd5b4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:56.951937 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-eac8d8d7-5691-4c87-8740-9405455cd5b4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:56.952839 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-eac8d8d7-5691-4c87-8740-9405455cd5b4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:57.110899 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-eac8d8d7-5691-4c87-8740-9405455cd5b4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:57.118804 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-eac8d8d7-5691-4c87-8740-9405455cd5b4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.182712 Sep 25 04:36:57.119414 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 105/173] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:56 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:57.124581 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-6ae33829-8696-4237-8779-e3218c798fc1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:57.125298 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-6ae33829-8696-4237-8779-e3218c798fc1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:57.134363 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6ae33829-8696-4237-8779-e3218c798fc1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:57.134363 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6ae33829-8696-4237-8779-e3218c798fc1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:57.134363 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6ae33829-8696-4237-8779-e3218c798fc1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:57.134363 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6ae33829-8696-4237-8779-e3218c798fc1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:57.134727 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6ae33829-8696-4237-8779-e3218c798fc1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:57.134727 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6ae33829-8696-4237-8779-e3218c798fc1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:57.267938 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-6ae33829-8696-4237-8779-e3218c798fc1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:57.276062 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-6ae33829-8696-4237-8779-e3218c798fc1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1363 microversion: 2.1 time: 0.155602 Sep 25 04:36:57.276686 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 106/174] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:57 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:57.626060 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-706ad5cb-b72b-4c7a-b7f3-2bec7f17ec67 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:57.627029 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-706ad5cb-b72b-4c7a-b7f3-2bec7f17ec67 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:57.634031 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-706ad5cb-b72b-4c7a-b7f3-2bec7f17ec67 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:57.634873 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-706ad5cb-b72b-4c7a-b7f3-2bec7f17ec67 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:57.635477 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-706ad5cb-b72b-4c7a-b7f3-2bec7f17ec67 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:57.636212 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-706ad5cb-b72b-4c7a-b7f3-2bec7f17ec67 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:57.636829 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-706ad5cb-b72b-4c7a-b7f3-2bec7f17ec67 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:57.637588 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-706ad5cb-b72b-4c7a-b7f3-2bec7f17ec67 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:57.786090 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-706ad5cb-b72b-4c7a-b7f3-2bec7f17ec67 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:57.794729 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-706ad5cb-b72b-4c7a-b7f3-2bec7f17ec67 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:57.796173 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-706ad5cb-b72b-4c7a-b7f3-2bec7f17ec67 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:57.797295 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-706ad5cb-b72b-4c7a-b7f3-2bec7f17ec67 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1407 microversion: 2.20 time: 0.176492 Sep 25 04:36:57.798227 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 107/175] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:36:57 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 04:36:57.957897 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-fcdbd399-2729-4efe-8623-b4fcb5792baa tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:57.958663 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-fcdbd399-2729-4efe-8623-b4fcb5792baa tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:57.972246 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fcdbd399-2729-4efe-8623-b4fcb5792baa tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:57.972836 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fcdbd399-2729-4efe-8623-b4fcb5792baa tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:57.973347 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fcdbd399-2729-4efe-8623-b4fcb5792baa tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:57.974134 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fcdbd399-2729-4efe-8623-b4fcb5792baa tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:57.974617 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fcdbd399-2729-4efe-8623-b4fcb5792baa tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:57.975203 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fcdbd399-2729-4efe-8623-b4fcb5792baa tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:58.119670 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-fcdbd399-2729-4efe-8623-b4fcb5792baa tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:58.127412 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-fcdbd399-2729-4efe-8623-b4fcb5792baa tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1364 microversion: 2.1 time: 0.173467 Sep 25 04:36:58.127896 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 108/176] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:57 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:36:58.143723 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-8b3e7cb6-92da-42dd-93cc-11c454c0318a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:58.144407 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-8b3e7cb6-92da-42dd-93cc-11c454c0318a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:58.150497 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8b3e7cb6-92da-42dd-93cc-11c454c0318a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:58.150974 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8b3e7cb6-92da-42dd-93cc-11c454c0318a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:58.151402 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8b3e7cb6-92da-42dd-93cc-11c454c0318a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:58.152088 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8b3e7cb6-92da-42dd-93cc-11c454c0318a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:58.152537 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8b3e7cb6-92da-42dd-93cc-11c454c0318a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:58.153183 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8b3e7cb6-92da-42dd-93cc-11c454c0318a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:58.157190 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=100 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:58.289115 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-8b3e7cb6-92da-42dd-93cc-11c454c0318a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:58.297667 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-8b3e7cb6-92da-42dd-93cc-11c454c0318a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.157847 Sep 25 04:36:58.298240 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 109/177] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:58 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:36:58.302839 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-67c516d7-1d5b-4b92-9fd3-01b4dfd7272f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:58.303438 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-67c516d7-1d5b-4b92-9fd3-01b4dfd7272f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:58.309147 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-67c516d7-1d5b-4b92-9fd3-01b4dfd7272f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:58.309636 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-67c516d7-1d5b-4b92-9fd3-01b4dfd7272f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:58.310074 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-67c516d7-1d5b-4b92-9fd3-01b4dfd7272f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:58.310765 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-67c516d7-1d5b-4b92-9fd3-01b4dfd7272f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:58.311222 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-67c516d7-1d5b-4b92-9fd3-01b4dfd7272f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:58.311646 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-67c516d7-1d5b-4b92-9fd3-01b4dfd7272f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:58.452747 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-67c516d7-1d5b-4b92-9fd3-01b4dfd7272f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:58.461396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-67c516d7-1d5b-4b92-9fd3-01b4dfd7272f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1363 microversion: 2.1 time: 0.161995 Sep 25 04:36:58.461966 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 110/178] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:58 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:36:58.511520 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=66 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:36:58.822993 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-d3803d8a-f294-4a62-8cf9-1481435b55cd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:58.823529 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-d3803d8a-f294-4a62-8cf9-1481435b55cd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:58.830063 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d3803d8a-f294-4a62-8cf9-1481435b55cd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:58.830542 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d3803d8a-f294-4a62-8cf9-1481435b55cd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:58.830976 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d3803d8a-f294-4a62-8cf9-1481435b55cd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:58.831658 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d3803d8a-f294-4a62-8cf9-1481435b55cd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:58.832105 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d3803d8a-f294-4a62-8cf9-1481435b55cd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:58.832817 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d3803d8a-f294-4a62-8cf9-1481435b55cd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:58.970947 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-d3803d8a-f294-4a62-8cf9-1481435b55cd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:58.979309 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-d3803d8a-f294-4a62-8cf9-1481435b55cd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:58.981051 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-d3803d8a-f294-4a62-8cf9-1481435b55cd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:58.982169 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-d3803d8a-f294-4a62-8cf9-1481435b55cd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1407 microversion: 2.20 time: 0.163167 Sep 25 04:36:58.982826 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 111/179] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:36:58 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 04:36:59.151068 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-527c4f44-4bda-41d5-a1d3-4d1158f4c750 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:59.151763 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-527c4f44-4bda-41d5-a1d3-4d1158f4c750 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:59.157980 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-527c4f44-4bda-41d5-a1d3-4d1158f4c750 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:59.158585 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-527c4f44-4bda-41d5-a1d3-4d1158f4c750 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:59.159114 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-527c4f44-4bda-41d5-a1d3-4d1158f4c750 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:59.160075 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-527c4f44-4bda-41d5-a1d3-4d1158f4c750 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:59.160735 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-527c4f44-4bda-41d5-a1d3-4d1158f4c750 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:59.161252 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-527c4f44-4bda-41d5-a1d3-4d1158f4c750 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:59.300275 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-527c4f44-4bda-41d5-a1d3-4d1158f4c750 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:59.308136 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-527c4f44-4bda-41d5-a1d3-4d1158f4c750 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1364 microversion: 2.1 time: 0.161365 Sep 25 04:36:59.308878 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 112/180] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:59 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:36:59.319847 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-9344bb01-8a77-4ec6-a5e9-d2bd422d9575 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:59.320721 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-9344bb01-8a77-4ec6-a5e9-d2bd422d9575 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:59.327168 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9344bb01-8a77-4ec6-a5e9-d2bd422d9575 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:59.327777 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9344bb01-8a77-4ec6-a5e9-d2bd422d9575 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:59.328405 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9344bb01-8a77-4ec6-a5e9-d2bd422d9575 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:59.329343 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9344bb01-8a77-4ec6-a5e9-d2bd422d9575 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:59.329946 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9344bb01-8a77-4ec6-a5e9-d2bd422d9575 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:59.330493 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9344bb01-8a77-4ec6-a5e9-d2bd422d9575 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:59.462717 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-9344bb01-8a77-4ec6-a5e9-d2bd422d9575 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:59.471578 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-9344bb01-8a77-4ec6-a5e9-d2bd422d9575 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.155441 Sep 25 04:36:59.472154 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 113/181] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:59 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:36:59.485428 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-d8246797-8ae9-4e04-8afd-bc0503dce710 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:36:59.486036 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-d8246797-8ae9-4e04-8afd-bc0503dce710 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:36:59.491966 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d8246797-8ae9-4e04-8afd-bc0503dce710 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:59.492453 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d8246797-8ae9-4e04-8afd-bc0503dce710 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:59.492969 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d8246797-8ae9-4e04-8afd-bc0503dce710 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:59.493668 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d8246797-8ae9-4e04-8afd-bc0503dce710 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:36:59.494123 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d8246797-8ae9-4e04-8afd-bc0503dce710 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:36:59.494548 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d8246797-8ae9-4e04-8afd-bc0503dce710 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:36:59.625113 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-d8246797-8ae9-4e04-8afd-bc0503dce710 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:36:59.632724 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-d8246797-8ae9-4e04-8afd-bc0503dce710 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1363 microversion: 2.1 time: 0.151295 Sep 25 04:36:59.633293 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 114/182] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:36:59 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:37:00.007597 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-83a0e1be-ddec-4f29-8031-cb7d127e9cd9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:00.008324 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-83a0e1be-ddec-4f29-8031-cb7d127e9cd9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:00.011313 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_api:SELECT=100 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:00.015642 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-83a0e1be-ddec-4f29-8031-cb7d127e9cd9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:00.016127 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-83a0e1be-ddec-4f29-8031-cb7d127e9cd9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:00.016559 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-83a0e1be-ddec-4f29-8031-cb7d127e9cd9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:00.017296 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-83a0e1be-ddec-4f29-8031-cb7d127e9cd9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:00.017748 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-83a0e1be-ddec-4f29-8031-cb7d127e9cd9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:00.018174 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-83a0e1be-ddec-4f29-8031-cb7d127e9cd9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:00.151781 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-83a0e1be-ddec-4f29-8031-cb7d127e9cd9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:00.160093 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-83a0e1be-ddec-4f29-8031-cb7d127e9cd9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:00.161565 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-83a0e1be-ddec-4f29-8031-cb7d127e9cd9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:00.162664 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-83a0e1be-ddec-4f29-8031-cb7d127e9cd9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1407 microversion: 2.20 time: 0.159120 Sep 25 04:37:00.163222 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 115/183] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:37:00 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 04:37:00.222084 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-55a15048-126b-4ca4-b408-e3bc8a2a174b req-9ca1b289-48cf-42f0-ab3e-84bbf8ab3140 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9be0143-7c91-4fba-8c2c-500f01573632", "name": "network-vif-plugged", "status": "completed", "tag": "352ac3fb-d005-4e6e-98b0-7339ef6c2202"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:37:00.232377 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-55a15048-126b-4ca4-b408-e3bc8a2a174b req-9ca1b289-48cf-42f0-ab3e-84bbf8ab3140 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:00.233040 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-55a15048-126b-4ca4-b408-e3bc8a2a174b req-9ca1b289-48cf-42f0-ab3e-84bbf8ab3140 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:00.233485 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-55a15048-126b-4ca4-b408-e3bc8a2a174b req-9ca1b289-48cf-42f0-ab3e-84bbf8ab3140 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:00.244771 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-55a15048-126b-4ca4-b408-e3bc8a2a174b req-9ca1b289-48cf-42f0-ab3e-84bbf8ab3140 service nova] Creating event network-vif-plugged:352ac3fb-d005-4e6e-98b0-7339ef6c2202 for instance c9be0143-7c91-4fba-8c2c-500f01573632 on hv-cinder-85535 Sep 25 04:37:00.250044 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-55a15048-126b-4ca4-b408-e3bc8a2a174b req-9ca1b289-48cf-42f0-ab3e-84bbf8ab3140 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031634 Sep 25 04:37:00.250636 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 116/184] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:37:00.334264 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-a234a1a9-bfb3-44bb-88f9-9c58a0a66e0d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:00.334965 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-a234a1a9-bfb3-44bb-88f9-9c58a0a66e0d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:00.341126 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a234a1a9-bfb3-44bb-88f9-9c58a0a66e0d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:00.341618 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a234a1a9-bfb3-44bb-88f9-9c58a0a66e0d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:00.342050 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a234a1a9-bfb3-44bb-88f9-9c58a0a66e0d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:00.342744 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a234a1a9-bfb3-44bb-88f9-9c58a0a66e0d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:00.343193 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a234a1a9-bfb3-44bb-88f9-9c58a0a66e0d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:00.343612 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a234a1a9-bfb3-44bb-88f9-9c58a0a66e0d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:00.482734 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-a234a1a9-bfb3-44bb-88f9-9c58a0a66e0d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:00.490351 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-a234a1a9-bfb3-44bb-88f9-9c58a0a66e0d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1364 microversion: 2.1 time: 0.160599 Sep 25 04:37:00.490901 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 117/185] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:00 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:37:00.501211 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-853e6880-1b23-4bee-b4d1-da8bff1115a3 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:00.501819 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-853e6880-1b23-4bee-b4d1-da8bff1115a3 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:00.507636 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-853e6880-1b23-4bee-b4d1-da8bff1115a3 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:00.508113 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-853e6880-1b23-4bee-b4d1-da8bff1115a3 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:00.508545 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-853e6880-1b23-4bee-b4d1-da8bff1115a3 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:00.509251 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-853e6880-1b23-4bee-b4d1-da8bff1115a3 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:00.509705 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-853e6880-1b23-4bee-b4d1-da8bff1115a3 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:00.510126 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-853e6880-1b23-4bee-b4d1-da8bff1115a3 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:00.643539 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-853e6880-1b23-4bee-b4d1-da8bff1115a3 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:00.651577 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-853e6880-1b23-4bee-b4d1-da8bff1115a3 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.154738 Sep 25 04:37:00.652142 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 118/186] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:00 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:37:00.656825 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-bf5ae156-4446-4d58-b66a-36f23910ca8b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:00.657425 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-bf5ae156-4446-4d58-b66a-36f23910ca8b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:00.663663 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bf5ae156-4446-4d58-b66a-36f23910ca8b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:00.664154 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bf5ae156-4446-4d58-b66a-36f23910ca8b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:00.664628 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bf5ae156-4446-4d58-b66a-36f23910ca8b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:00.665372 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bf5ae156-4446-4d58-b66a-36f23910ca8b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:00.665826 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bf5ae156-4446-4d58-b66a-36f23910ca8b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:00.666251 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bf5ae156-4446-4d58-b66a-36f23910ca8b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:00.792793 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-bf5ae156-4446-4d58-b66a-36f23910ca8b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:00.800799 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-bf5ae156-4446-4d58-b66a-36f23910ca8b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1363 microversion: 2.1 time: 0.147689 Sep 25 04:37:00.801362 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 119/187] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:00 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:01.188557 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-fcd5bdba-14a0-49c5-bf3d-62f79bcfc7d9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:01.189241 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-fcd5bdba-14a0-49c5-bf3d-62f79bcfc7d9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:01.195160 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fcd5bdba-14a0-49c5-bf3d-62f79bcfc7d9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:01.195639 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fcd5bdba-14a0-49c5-bf3d-62f79bcfc7d9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:01.196067 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fcd5bdba-14a0-49c5-bf3d-62f79bcfc7d9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:01.196787 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fcd5bdba-14a0-49c5-bf3d-62f79bcfc7d9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:01.197241 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fcd5bdba-14a0-49c5-bf3d-62f79bcfc7d9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:01.197662 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fcd5bdba-14a0-49c5-bf3d-62f79bcfc7d9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:01.324301 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-fcd5bdba-14a0-49c5-bf3d-62f79bcfc7d9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:01.332679 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-fcd5bdba-14a0-49c5-bf3d-62f79bcfc7d9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:01.334159 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-fcd5bdba-14a0-49c5-bf3d-62f79bcfc7d9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:01.335242 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-fcd5bdba-14a0-49c5-bf3d-62f79bcfc7d9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1407 microversion: 2.20 time: 0.150630 Sep 25 04:37:01.335787 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 120/188] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:37:01 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 04:37:01.514508 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-64468675-61b0-4583-bfab-ed11253ba9b8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:01.515506 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-64468675-61b0-4583-bfab-ed11253ba9b8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:01.521556 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-64468675-61b0-4583-bfab-ed11253ba9b8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:01.522039 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-64468675-61b0-4583-bfab-ed11253ba9b8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:01.522474 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-64468675-61b0-4583-bfab-ed11253ba9b8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:01.523581 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-64468675-61b0-4583-bfab-ed11253ba9b8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:01.524062 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-64468675-61b0-4583-bfab-ed11253ba9b8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:01.526367 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-64468675-61b0-4583-bfab-ed11253ba9b8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:01.662067 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-64468675-61b0-4583-bfab-ed11253ba9b8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:01.671237 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-64468675-61b0-4583-bfab-ed11253ba9b8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1364 microversion: 2.1 time: 0.161043 Sep 25 04:37:01.672103 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 121/189] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:01 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:01.676987 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-31e9cb3a-e507-4e3e-a101-ff33c8dcd53c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:01.677662 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-31e9cb3a-e507-4e3e-a101-ff33c8dcd53c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:01.683751 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-31e9cb3a-e507-4e3e-a101-ff33c8dcd53c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:01.684445 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-31e9cb3a-e507-4e3e-a101-ff33c8dcd53c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:01.685139 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-31e9cb3a-e507-4e3e-a101-ff33c8dcd53c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:01.686206 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-31e9cb3a-e507-4e3e-a101-ff33c8dcd53c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:01.687010 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-31e9cb3a-e507-4e3e-a101-ff33c8dcd53c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:01.688093 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-31e9cb3a-e507-4e3e-a101-ff33c8dcd53c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:01.904495 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-b1dce5f6-ab2d-4a76-a14c-517ecfedcdfd tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "POST /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 13.591211 Sep 25 04:37:01.905704 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 69/190] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Sep 25 04:36:48 2022] POST /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2/os-volume_attachments => generated 194 bytes in 13593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 04:37:01.910818 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-0c31b4a6-ab00-4329-b2c6-44164758cbbe tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:01.911309 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-0c31b4a6-ab00-4329-b2c6-44164758cbbe tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:01.917485 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0c31b4a6-ab00-4329-b2c6-44164758cbbe tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:01.918158 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0c31b4a6-ab00-4329-b2c6-44164758cbbe tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:01.918531 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0c31b4a6-ab00-4329-b2c6-44164758cbbe tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:01.919235 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0c31b4a6-ab00-4329-b2c6-44164758cbbe tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:01.919688 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0c31b4a6-ab00-4329-b2c6-44164758cbbe tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:01.920114 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0c31b4a6-ab00-4329-b2c6-44164758cbbe tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:01.973650 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-31e9cb3a-e507-4e3e-a101-ff33c8dcd53c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:01.982224 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-31e9cb3a-e507-4e3e-a101-ff33c8dcd53c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.308591 Sep 25 04:37:01.982793 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 122/191] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:01 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:02.110955 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-0c31b4a6-ab00-4329-b2c6-44164758cbbe tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:02.119179 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-0c31b4a6-ab00-4329-b2c6-44164758cbbe tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1363 microversion: 2.1 time: 0.212432 Sep 25 04:37:02.120392 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 70/192] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:01 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:02.360585 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-7f1a5f04-cecf-45c8-a259-a5aea5de2e3d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:02.361229 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-7f1a5f04-cecf-45c8-a259-a5aea5de2e3d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:02.367685 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7f1a5f04-cecf-45c8-a259-a5aea5de2e3d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:02.368174 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7f1a5f04-cecf-45c8-a259-a5aea5de2e3d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:02.368612 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7f1a5f04-cecf-45c8-a259-a5aea5de2e3d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:02.369396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7f1a5f04-cecf-45c8-a259-a5aea5de2e3d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:02.369855 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7f1a5f04-cecf-45c8-a259-a5aea5de2e3d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:02.370281 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7f1a5f04-cecf-45c8-a259-a5aea5de2e3d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:02.506497 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-7f1a5f04-cecf-45c8-a259-a5aea5de2e3d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:02.515822 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-7f1a5f04-cecf-45c8-a259-a5aea5de2e3d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:02.517413 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-7f1a5f04-cecf-45c8-a259-a5aea5de2e3d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:02.518599 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-7f1a5f04-cecf-45c8-a259-a5aea5de2e3d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1407 microversion: 2.20 time: 0.162542 Sep 25 04:37:02.519241 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 123/193] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:37:02 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:37:02.694701 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-06f06032-33d1-411d-88a6-5eb0c95fde39 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:02.695306 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-06f06032-33d1-411d-88a6-5eb0c95fde39 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:02.701705 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-06f06032-33d1-411d-88a6-5eb0c95fde39 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:02.702179 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-06f06032-33d1-411d-88a6-5eb0c95fde39 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:02.702608 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-06f06032-33d1-411d-88a6-5eb0c95fde39 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:02.703291 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-06f06032-33d1-411d-88a6-5eb0c95fde39 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:02.703737 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-06f06032-33d1-411d-88a6-5eb0c95fde39 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:02.704154 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-06f06032-33d1-411d-88a6-5eb0c95fde39 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:03.006586 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-fed65ad5-fccd-4beb-8977-c5b453e239c5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:03.007199 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-fed65ad5-fccd-4beb-8977-c5b453e239c5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:03.016052 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fed65ad5-fccd-4beb-8977-c5b453e239c5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:03.016667 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fed65ad5-fccd-4beb-8977-c5b453e239c5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:03.017134 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fed65ad5-fccd-4beb-8977-c5b453e239c5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:03.017886 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fed65ad5-fccd-4beb-8977-c5b453e239c5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:03.018504 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fed65ad5-fccd-4beb-8977-c5b453e239c5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:03.018940 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fed65ad5-fccd-4beb-8977-c5b453e239c5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:03.196716 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-06f06032-33d1-411d-88a6-5eb0c95fde39 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:03.208520 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-06f06032-33d1-411d-88a6-5eb0c95fde39 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1364 microversion: 2.1 time: 0.517633 Sep 25 04:37:03.209161 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 71/194] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:02 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1364 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:03.214570 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-a7b8f109-0d2b-4fe3-9c70-d04926075e96 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:03.215256 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-a7b8f109-0d2b-4fe3-9c70-d04926075e96 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:03.223983 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a7b8f109-0d2b-4fe3-9c70-d04926075e96 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:03.224791 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a7b8f109-0d2b-4fe3-9c70-d04926075e96 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:03.225157 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a7b8f109-0d2b-4fe3-9c70-d04926075e96 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:03.226034 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a7b8f109-0d2b-4fe3-9c70-d04926075e96 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:03.226497 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a7b8f109-0d2b-4fe3-9c70-d04926075e96 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:03.226963 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a7b8f109-0d2b-4fe3-9c70-d04926075e96 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:03.505749 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-fed65ad5-fccd-4beb-8977-c5b453e239c5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:03.514280 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-fed65ad5-fccd-4beb-8977-c5b453e239c5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.511837 Sep 25 04:37:03.514863 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 124/195] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:03 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:37:03.544485 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-d31764e0-a121-427f-8a91-f700265a5d33 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:03.545884 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-d31764e0-a121-427f-8a91-f700265a5d33 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:03.553551 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d31764e0-a121-427f-8a91-f700265a5d33 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:03.553551 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d31764e0-a121-427f-8a91-f700265a5d33 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:03.553786 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d31764e0-a121-427f-8a91-f700265a5d33 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:03.554472 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d31764e0-a121-427f-8a91-f700265a5d33 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:03.554967 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d31764e0-a121-427f-8a91-f700265a5d33 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:03.555453 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d31764e0-a121-427f-8a91-f700265a5d33 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:03.565382 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-a7b8f109-0d2b-4fe3-9c70-d04926075e96 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:03.574344 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-a7b8f109-0d2b-4fe3-9c70-d04926075e96 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1363 microversion: 2.1 time: 0.363883 Sep 25 04:37:03.575224 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 72/196] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:03 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1363 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:03.697372 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-d31764e0-a121-427f-8a91-f700265a5d33 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:03.707903 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-d31764e0-a121-427f-8a91-f700265a5d33 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:03.709832 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-d31764e0-a121-427f-8a91-f700265a5d33 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:03.711309 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-d31764e0-a121-427f-8a91-f700265a5d33 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1407 microversion: 2.20 time: 0.171995 Sep 25 04:37:03.712172 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 125/197] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:37:03 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 04:37:04.231598 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-0e4ff83e-ab05-4155-95f4-1165bb97455a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:04.232200 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-0e4ff83e-ab05-4155-95f4-1165bb97455a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:04.238699 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0e4ff83e-ab05-4155-95f4-1165bb97455a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:04.239184 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0e4ff83e-ab05-4155-95f4-1165bb97455a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:04.239611 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0e4ff83e-ab05-4155-95f4-1165bb97455a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:04.240289 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0e4ff83e-ab05-4155-95f4-1165bb97455a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:04.240782 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0e4ff83e-ab05-4155-95f4-1165bb97455a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:04.241209 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0e4ff83e-ab05-4155-95f4-1165bb97455a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:04.398419 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-0e4ff83e-ab05-4155-95f4-1165bb97455a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:04.407151 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-0e4ff83e-ab05-4155-95f4-1165bb97455a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1364 microversion: 2.1 time: 0.179737 Sep 25 04:37:04.407720 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 73/198] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:04 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:04.461025 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-117aa4be-10d2-4128-bcf6-41b0f3089a71 req-447900d6-4a70-48f8-840f-c530571ac961 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9e99419-ae76-4d84-9e7a-d0a31530ea14", "name": "network-vif-plugged", "status": "completed", "tag": "28807ae7-bb46-4e31-93d7-48170864edca"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:37:04.471399 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-117aa4be-10d2-4128-bcf6-41b0f3089a71 req-447900d6-4a70-48f8-840f-c530571ac961 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:04.471738 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-117aa4be-10d2-4128-bcf6-41b0f3089a71 req-447900d6-4a70-48f8-840f-c530571ac961 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:04.472371 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-117aa4be-10d2-4128-bcf6-41b0f3089a71 req-447900d6-4a70-48f8-840f-c530571ac961 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:04.489929 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-117aa4be-10d2-4128-bcf6-41b0f3089a71 req-447900d6-4a70-48f8-840f-c530571ac961 service nova] Creating event network-vif-plugged:28807ae7-bb46-4e31-93d7-48170864edca for instance c9e99419-ae76-4d84-9e7a-d0a31530ea14 on hv-cinder-85535 Sep 25 04:37:04.495657 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-117aa4be-10d2-4128-bcf6-41b0f3089a71 req-447900d6-4a70-48f8-840f-c530571ac961 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038969 Sep 25 04:37:04.497057 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 126/199] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:37:04.539226 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-d288a5e9-3f7c-45d3-990a-99ecc8a56f9c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:04.540134 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-d288a5e9-3f7c-45d3-990a-99ecc8a56f9c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:04.546697 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d288a5e9-3f7c-45d3-990a-99ecc8a56f9c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:04.547194 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d288a5e9-3f7c-45d3-990a-99ecc8a56f9c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:04.547624 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d288a5e9-3f7c-45d3-990a-99ecc8a56f9c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:04.548523 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d288a5e9-3f7c-45d3-990a-99ecc8a56f9c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:04.549154 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d288a5e9-3f7c-45d3-990a-99ecc8a56f9c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:04.549575 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d288a5e9-3f7c-45d3-990a-99ecc8a56f9c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:04.601882 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-f0ddc983-7737-40ac-b15a-95f4ac82b466 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:04.602865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-f0ddc983-7737-40ac-b15a-95f4ac82b466 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:04.617418 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f0ddc983-7737-40ac-b15a-95f4ac82b466 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:04.618167 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f0ddc983-7737-40ac-b15a-95f4ac82b466 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:04.618838 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f0ddc983-7737-40ac-b15a-95f4ac82b466 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:04.620210 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f0ddc983-7737-40ac-b15a-95f4ac82b466 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:04.622342 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f0ddc983-7737-40ac-b15a-95f4ac82b466 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:04.623135 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f0ddc983-7737-40ac-b15a-95f4ac82b466 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:04.628869 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=100 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:04.771401 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-d288a5e9-3f7c-45d3-990a-99ecc8a56f9c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:04.785919 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-d288a5e9-3f7c-45d3-990a-99ecc8a56f9c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.251505 Sep 25 04:37:04.803515 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 74/200] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:04 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:04.809483 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-0f89e42f-54db-43be-942a-e51af6f25e54 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:04.810131 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-0f89e42f-54db-43be-942a-e51af6f25e54 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:04.818379 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0f89e42f-54db-43be-942a-e51af6f25e54 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:04.819228 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0f89e42f-54db-43be-942a-e51af6f25e54 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:04.819988 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0f89e42f-54db-43be-942a-e51af6f25e54 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:04.820903 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0f89e42f-54db-43be-942a-e51af6f25e54 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:04.821584 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0f89e42f-54db-43be-942a-e51af6f25e54 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:04.822202 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0f89e42f-54db-43be-942a-e51af6f25e54 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:04.829516 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-f0ddc983-7737-40ac-b15a-95f4ac82b466 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:04.847506 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-f0ddc983-7737-40ac-b15a-95f4ac82b466 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1363 microversion: 2.1 time: 0.251260 Sep 25 04:37:04.863664 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 127/201] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:04 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1363 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:37:04.976820 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-0f89e42f-54db-43be-942a-e51af6f25e54 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:04.984052 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-0f89e42f-54db-43be-942a-e51af6f25e54 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:04.985536 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-0f89e42f-54db-43be-942a-e51af6f25e54 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:04.986642 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-0f89e42f-54db-43be-942a-e51af6f25e54 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1407 microversion: 2.20 time: 0.182024 Sep 25 04:37:04.987158 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 75/202] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:37:04 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:37:05.430523 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-5f8d492c-9007-477d-8d92-1c6bb9343660 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:05.431132 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-5f8d492c-9007-477d-8d92-1c6bb9343660 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:05.437872 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5f8d492c-9007-477d-8d92-1c6bb9343660 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:05.438354 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5f8d492c-9007-477d-8d92-1c6bb9343660 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:05.438786 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5f8d492c-9007-477d-8d92-1c6bb9343660 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:05.439464 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5f8d492c-9007-477d-8d92-1c6bb9343660 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:05.439916 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5f8d492c-9007-477d-8d92-1c6bb9343660 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:05.440338 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5f8d492c-9007-477d-8d92-1c6bb9343660 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:05.579713 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-5f8d492c-9007-477d-8d92-1c6bb9343660 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:05.587602 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-5f8d492c-9007-477d-8d92-1c6bb9343660 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1364 microversion: 2.1 time: 0.160892 Sep 25 04:37:05.588177 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 128/203] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:05 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:05.818160 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-d02d8548-b4b2-4b65-a895-2d9c706bec52 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:05.818948 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-d02d8548-b4b2-4b65-a895-2d9c706bec52 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:05.826761 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d02d8548-b4b2-4b65-a895-2d9c706bec52 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:05.827606 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d02d8548-b4b2-4b65-a895-2d9c706bec52 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:05.828202 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d02d8548-b4b2-4b65-a895-2d9c706bec52 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:05.829325 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d02d8548-b4b2-4b65-a895-2d9c706bec52 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:05.829857 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d02d8548-b4b2-4b65-a895-2d9c706bec52 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:05.830617 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d02d8548-b4b2-4b65-a895-2d9c706bec52 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:05.872426 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-e02de44f-4671-4488-a49a-7a7e0b676394 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:05.873234 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-e02de44f-4671-4488-a49a-7a7e0b676394 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:05.880454 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e02de44f-4671-4488-a49a-7a7e0b676394 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:05.881042 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e02de44f-4671-4488-a49a-7a7e0b676394 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:05.881674 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e02de44f-4671-4488-a49a-7a7e0b676394 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:05.882386 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e02de44f-4671-4488-a49a-7a7e0b676394 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:05.882848 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e02de44f-4671-4488-a49a-7a7e0b676394 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:05.883308 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e02de44f-4671-4488-a49a-7a7e0b676394 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:06.025636 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-d02d8548-b4b2-4b65-a895-2d9c706bec52 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:06.034720 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-d02d8548-b4b2-4b65-a895-2d9c706bec52 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.221433 Sep 25 04:37:06.035293 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 76/204] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:05 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:06.040020 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-24220321-f52c-4363-885c-1197bfa7fac0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:06.040469 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-24220321-f52c-4363-885c-1197bfa7fac0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:06.046899 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-24220321-f52c-4363-885c-1197bfa7fac0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:06.047383 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-24220321-f52c-4363-885c-1197bfa7fac0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:06.050400 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-e02de44f-4671-4488-a49a-7a7e0b676394 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:06.051480 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-24220321-f52c-4363-885c-1197bfa7fac0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:06.052225 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-24220321-f52c-4363-885c-1197bfa7fac0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:06.052729 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-24220321-f52c-4363-885c-1197bfa7fac0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:06.053167 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-24220321-f52c-4363-885c-1197bfa7fac0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:06.057965 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-e02de44f-4671-4488-a49a-7a7e0b676394 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1363 microversion: 2.1 time: 0.189662 Sep 25 04:37:06.058530 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 129/205] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:05 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:37:06.186264 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-24220321-f52c-4363-885c-1197bfa7fac0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:06.196198 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-24220321-f52c-4363-885c-1197bfa7fac0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:06.197698 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-24220321-f52c-4363-885c-1197bfa7fac0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:06.198816 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-24220321-f52c-4363-885c-1197bfa7fac0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1407 microversion: 2.20 time: 0.162596 Sep 25 04:37:06.199935 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 77/206] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:37:06 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:37:06.610646 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-e1ef140c-8622-4691-8e0b-20c64332b45c tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:06.611269 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-e1ef140c-8622-4691-8e0b-20c64332b45c tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:06.617150 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e1ef140c-8622-4691-8e0b-20c64332b45c tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:06.617628 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e1ef140c-8622-4691-8e0b-20c64332b45c tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:06.618056 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e1ef140c-8622-4691-8e0b-20c64332b45c tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:06.618724 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e1ef140c-8622-4691-8e0b-20c64332b45c tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:06.619172 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e1ef140c-8622-4691-8e0b-20c64332b45c tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:06.619585 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e1ef140c-8622-4691-8e0b-20c64332b45c tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:06.752839 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-e1ef140c-8622-4691-8e0b-20c64332b45c tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:06.760866 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-e1ef140c-8622-4691-8e0b-20c64332b45c tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1364 microversion: 2.1 time: 0.154011 Sep 25 04:37:06.761435 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 130/207] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:06 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:07.058197 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-5c6ad058-c0bf-42b7-8d39-6b830166a717 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:07.058841 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-5c6ad058-c0bf-42b7-8d39-6b830166a717 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:07.065439 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5c6ad058-c0bf-42b7-8d39-6b830166a717 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:07.065923 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5c6ad058-c0bf-42b7-8d39-6b830166a717 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:07.066355 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5c6ad058-c0bf-42b7-8d39-6b830166a717 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:07.067033 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5c6ad058-c0bf-42b7-8d39-6b830166a717 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:07.067478 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5c6ad058-c0bf-42b7-8d39-6b830166a717 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:07.068000 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5c6ad058-c0bf-42b7-8d39-6b830166a717 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:07.080243 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-a821dca9-4c41-41c4-86ee-8e20aba078fd tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:07.080982 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-a821dca9-4c41-41c4-86ee-8e20aba078fd tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:07.087137 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a821dca9-4c41-41c4-86ee-8e20aba078fd tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:07.087623 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a821dca9-4c41-41c4-86ee-8e20aba078fd tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:07.088061 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a821dca9-4c41-41c4-86ee-8e20aba078fd tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:07.088775 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a821dca9-4c41-41c4-86ee-8e20aba078fd tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:07.089229 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a821dca9-4c41-41c4-86ee-8e20aba078fd tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:07.089655 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a821dca9-4c41-41c4-86ee-8e20aba078fd tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:07.254560 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-5c6ad058-c0bf-42b7-8d39-6b830166a717 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:07.264746 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-5c6ad058-c0bf-42b7-8d39-6b830166a717 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.210087 Sep 25 04:37:07.265423 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 78/208] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:07 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:07.271853 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-dac6c05d-4cb3-4037-b690-539cb2024081 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:07.272539 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-dac6c05d-4cb3-4037-b690-539cb2024081 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:07.278280 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-a821dca9-4c41-41c4-86ee-8e20aba078fd tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:07.284683 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-dac6c05d-4cb3-4037-b690-539cb2024081 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:07.285176 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-dac6c05d-4cb3-4037-b690-539cb2024081 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:07.285635 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-dac6c05d-4cb3-4037-b690-539cb2024081 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:07.286032 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-a821dca9-4c41-41c4-86ee-8e20aba078fd tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1363 microversion: 2.1 time: 0.209561 Sep 25 04:37:07.286324 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-dac6c05d-4cb3-4037-b690-539cb2024081 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:07.286778 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 131/209] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:07 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:07.286886 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-dac6c05d-4cb3-4037-b690-539cb2024081 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:07.287173 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-dac6c05d-4cb3-4037-b690-539cb2024081 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:07.417971 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-dac6c05d-4cb3-4037-b690-539cb2024081 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:07.427070 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-dac6c05d-4cb3-4037-b690-539cb2024081 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:07.428500 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-dac6c05d-4cb3-4037-b690-539cb2024081 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:07.429617 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-dac6c05d-4cb3-4037-b690-539cb2024081 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1407 microversion: 2.20 time: 0.162723 Sep 25 04:37:07.430171 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 79/210] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:37:07 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:37:07.784063 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-3398ab20-b166-4fde-bdb8-c881236ee616 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:07.784699 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-3398ab20-b166-4fde-bdb8-c881236ee616 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:07.790764 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3398ab20-b166-4fde-bdb8-c881236ee616 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:07.791219 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3398ab20-b166-4fde-bdb8-c881236ee616 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:07.791658 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3398ab20-b166-4fde-bdb8-c881236ee616 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:07.792340 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3398ab20-b166-4fde-bdb8-c881236ee616 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:07.792832 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3398ab20-b166-4fde-bdb8-c881236ee616 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:07.793290 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3398ab20-b166-4fde-bdb8-c881236ee616 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:07.925199 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-3398ab20-b166-4fde-bdb8-c881236ee616 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:07.932835 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-3398ab20-b166-4fde-bdb8-c881236ee616 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1364 microversion: 2.1 time: 0.152651 Sep 25 04:37:07.933400 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 132/211] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:07 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:08.287506 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-05ff6c0b-a3f5-40b5-872e-da064f6fef92 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:08.288107 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-05ff6c0b-a3f5-40b5-872e-da064f6fef92 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:08.296245 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-05ff6c0b-a3f5-40b5-872e-da064f6fef92 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:08.296762 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-05ff6c0b-a3f5-40b5-872e-da064f6fef92 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:08.297214 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-05ff6c0b-a3f5-40b5-872e-da064f6fef92 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:08.297892 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-05ff6c0b-a3f5-40b5-872e-da064f6fef92 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:08.298345 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-05ff6c0b-a3f5-40b5-872e-da064f6fef92 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:08.298772 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-05ff6c0b-a3f5-40b5-872e-da064f6fef92 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:08.308513 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-c7186e8f-7fa5-4a79-acad-00cfc9084053 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:08.309963 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-c7186e8f-7fa5-4a79-acad-00cfc9084053 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:08.316535 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c7186e8f-7fa5-4a79-acad-00cfc9084053 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:08.317016 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c7186e8f-7fa5-4a79-acad-00cfc9084053 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:08.317442 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c7186e8f-7fa5-4a79-acad-00cfc9084053 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:08.318131 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c7186e8f-7fa5-4a79-acad-00cfc9084053 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:08.318572 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c7186e8f-7fa5-4a79-acad-00cfc9084053 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:08.319378 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c7186e8f-7fa5-4a79-acad-00cfc9084053 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:08.499416 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-05ff6c0b-a3f5-40b5-872e-da064f6fef92 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:08.507139 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-05ff6c0b-a3f5-40b5-872e-da064f6fef92 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.223505 Sep 25 04:37:08.507716 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 80/212] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:08 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:08.512894 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-1b54f09e-aa5f-4ccc-9fe7-e5f5ea6f223c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:08.513534 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-1b54f09e-aa5f-4ccc-9fe7-e5f5ea6f223c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:08.516521 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-c7186e8f-7fa5-4a79-acad-00cfc9084053 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:08.519731 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1b54f09e-aa5f-4ccc-9fe7-e5f5ea6f223c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:08.520383 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1b54f09e-aa5f-4ccc-9fe7-e5f5ea6f223c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:08.520859 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1b54f09e-aa5f-4ccc-9fe7-e5f5ea6f223c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:08.521555 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1b54f09e-aa5f-4ccc-9fe7-e5f5ea6f223c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:08.522012 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1b54f09e-aa5f-4ccc-9fe7-e5f5ea6f223c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:08.522436 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1b54f09e-aa5f-4ccc-9fe7-e5f5ea6f223c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:08.525142 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-c7186e8f-7fa5-4a79-acad-00cfc9084053 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1363 microversion: 2.1 time: 0.220292 Sep 25 04:37:08.525791 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 133/213] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:08 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:37:08.651099 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-1b54f09e-aa5f-4ccc-9fe7-e5f5ea6f223c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:08.660118 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-1b54f09e-aa5f-4ccc-9fe7-e5f5ea6f223c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:08.661616 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-1b54f09e-aa5f-4ccc-9fe7-e5f5ea6f223c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:08.662731 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-1b54f09e-aa5f-4ccc-9fe7-e5f5ea6f223c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1407 microversion: 2.20 time: 0.154100 Sep 25 04:37:08.663289 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 81/214] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:37:08 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:37:08.956759 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-5100c441-b0ae-4cd9-b394-7009cb2dab62 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:08.957372 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-5100c441-b0ae-4cd9-b394-7009cb2dab62 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:08.964191 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5100c441-b0ae-4cd9-b394-7009cb2dab62 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:08.964991 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5100c441-b0ae-4cd9-b394-7009cb2dab62 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:08.965270 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5100c441-b0ae-4cd9-b394-7009cb2dab62 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:08.965903 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5100c441-b0ae-4cd9-b394-7009cb2dab62 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:08.966355 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5100c441-b0ae-4cd9-b394-7009cb2dab62 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:08.966780 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5100c441-b0ae-4cd9-b394-7009cb2dab62 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:09.096465 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-5100c441-b0ae-4cd9-b394-7009cb2dab62 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:09.104459 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-5100c441-b0ae-4cd9-b394-7009cb2dab62 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1364 microversion: 2.1 time: 0.151561 Sep 25 04:37:09.105062 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 134/215] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:08 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:09.531987 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-9ff2d0d9-3c99-4a5c-a5ea-6dc67dfdfb38 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:09.532601 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-9ff2d0d9-3c99-4a5c-a5ea-6dc67dfdfb38 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:09.539080 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9ff2d0d9-3c99-4a5c-a5ea-6dc67dfdfb38 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:09.539644 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9ff2d0d9-3c99-4a5c-a5ea-6dc67dfdfb38 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:09.540184 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9ff2d0d9-3c99-4a5c-a5ea-6dc67dfdfb38 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:09.541111 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9ff2d0d9-3c99-4a5c-a5ea-6dc67dfdfb38 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:09.541587 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9ff2d0d9-3c99-4a5c-a5ea-6dc67dfdfb38 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:09.542049 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9ff2d0d9-3c99-4a5c-a5ea-6dc67dfdfb38 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:09.549008 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-5d90d18f-fde9-4b98-859a-dd429ddb228a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:09.549619 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-5d90d18f-fde9-4b98-859a-dd429ddb228a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:09.555526 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5d90d18f-fde9-4b98-859a-dd429ddb228a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:09.556009 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5d90d18f-fde9-4b98-859a-dd429ddb228a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:09.556440 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5d90d18f-fde9-4b98-859a-dd429ddb228a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:09.557160 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5d90d18f-fde9-4b98-859a-dd429ddb228a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:09.557608 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5d90d18f-fde9-4b98-859a-dd429ddb228a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:09.558032 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5d90d18f-fde9-4b98-859a-dd429ddb228a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:09.742599 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-9ff2d0d9-3c99-4a5c-a5ea-6dc67dfdfb38 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:09.746139 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-5d90d18f-fde9-4b98-859a-dd429ddb228a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:09.750665 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-9ff2d0d9-3c99-4a5c-a5ea-6dc67dfdfb38 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.223261 Sep 25 04:37:09.751233 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 82/216] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:09 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:09.754050 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-5d90d18f-fde9-4b98-859a-dd429ddb228a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1363 microversion: 2.1 time: 0.208850 Sep 25 04:37:09.754737 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 135/217] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:09 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:37:09.755676 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-d5ca2b73-9c24-4508-9fe7-93d181b95dcf tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:09.756279 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-d5ca2b73-9c24-4508-9fe7-93d181b95dcf tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:09.763061 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d5ca2b73-9c24-4508-9fe7-93d181b95dcf tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:09.763549 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d5ca2b73-9c24-4508-9fe7-93d181b95dcf tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:09.763990 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d5ca2b73-9c24-4508-9fe7-93d181b95dcf tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:09.764713 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d5ca2b73-9c24-4508-9fe7-93d181b95dcf tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:09.765174 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d5ca2b73-9c24-4508-9fe7-93d181b95dcf tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:09.765599 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d5ca2b73-9c24-4508-9fe7-93d181b95dcf tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:09.897282 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-d5ca2b73-9c24-4508-9fe7-93d181b95dcf tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:09.906028 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-d5ca2b73-9c24-4508-9fe7-93d181b95dcf tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:09.907465 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-d5ca2b73-9c24-4508-9fe7-93d181b95dcf tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:09.908565 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-d5ca2b73-9c24-4508-9fe7-93d181b95dcf tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1407 microversion: 2.20 time: 0.156418 Sep 25 04:37:09.909165 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 83/218] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:37:09 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:37:10.128018 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-8dd36ca5-0aa0-4f2d-b549-1c128757fd37 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:10.128575 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-8dd36ca5-0aa0-4f2d-b549-1c128757fd37 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:10.134844 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8dd36ca5-0aa0-4f2d-b549-1c128757fd37 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:10.135329 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8dd36ca5-0aa0-4f2d-b549-1c128757fd37 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:10.135761 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8dd36ca5-0aa0-4f2d-b549-1c128757fd37 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:10.136451 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8dd36ca5-0aa0-4f2d-b549-1c128757fd37 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:10.137510 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8dd36ca5-0aa0-4f2d-b549-1c128757fd37 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:10.137938 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8dd36ca5-0aa0-4f2d-b549-1c128757fd37 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:10.271247 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-8dd36ca5-0aa0-4f2d-b549-1c128757fd37 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:10.279171 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-8dd36ca5-0aa0-4f2d-b549-1c128757fd37 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1364 microversion: 2.1 time: 0.155032 Sep 25 04:37:10.279739 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 136/219] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:10 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:10.774157 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-195debd7-d96c-4714-ae7b-d03e26428e74 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:10.774760 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-195debd7-d96c-4714-ae7b-d03e26428e74 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:10.776835 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-94b0640c-8b7f-4443-ba78-381ff49f78a1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:10.777467 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-94b0640c-8b7f-4443-ba78-381ff49f78a1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:10.781575 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-195debd7-d96c-4714-ae7b-d03e26428e74 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:10.782060 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-195debd7-d96c-4714-ae7b-d03e26428e74 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:10.782491 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-195debd7-d96c-4714-ae7b-d03e26428e74 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:10.783175 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-195debd7-d96c-4714-ae7b-d03e26428e74 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:10.783448 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-94b0640c-8b7f-4443-ba78-381ff49f78a1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:10.783622 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-195debd7-d96c-4714-ae7b-d03e26428e74 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:10.783929 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-94b0640c-8b7f-4443-ba78-381ff49f78a1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:10.784033 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-195debd7-d96c-4714-ae7b-d03e26428e74 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:10.784358 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-94b0640c-8b7f-4443-ba78-381ff49f78a1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:10.785059 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-94b0640c-8b7f-4443-ba78-381ff49f78a1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:10.785505 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-94b0640c-8b7f-4443-ba78-381ff49f78a1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:10.785923 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-94b0640c-8b7f-4443-ba78-381ff49f78a1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:10.978402 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-195debd7-d96c-4714-ae7b-d03e26428e74 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:10.982834 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-94b0640c-8b7f-4443-ba78-381ff49f78a1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:10.986233 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-195debd7-d96c-4714-ae7b-d03e26428e74 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.215920 Sep 25 04:37:10.987027 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 84/220] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:10 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:10.990924 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-94b0640c-8b7f-4443-ba78-381ff49f78a1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1363 microversion: 2.1 time: 0.217971 Sep 25 04:37:10.991253 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-6d3795ce-ee6a-4dc4-b4e5-121f5c688a0b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:11.000757 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 137/221] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:10 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:37:11.000894 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-6d3795ce-ee6a-4dc4-b4e5-121f5c688a0b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:11.000894 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6d3795ce-ee6a-4dc4-b4e5-121f5c688a0b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:11.000894 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6d3795ce-ee6a-4dc4-b4e5-121f5c688a0b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:11.000894 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6d3795ce-ee6a-4dc4-b4e5-121f5c688a0b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:11.001175 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6d3795ce-ee6a-4dc4-b4e5-121f5c688a0b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:11.001175 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6d3795ce-ee6a-4dc4-b4e5-121f5c688a0b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:11.001175 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6d3795ce-ee6a-4dc4-b4e5-121f5c688a0b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:11.004720 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:11.133624 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-6d3795ce-ee6a-4dc4-b4e5-121f5c688a0b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:11.142483 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-6d3795ce-ee6a-4dc4-b4e5-121f5c688a0b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:11.143918 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-6d3795ce-ee6a-4dc4-b4e5-121f5c688a0b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:11.145032 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-6d3795ce-ee6a-4dc4-b4e5-121f5c688a0b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1407 microversion: 2.20 time: 0.157285 Sep 25 04:37:11.145589 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 85/222] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:37:10 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:37:11.303512 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-616d009b-8bcf-4346-82b2-2d35293885d4 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:11.304072 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-616d009b-8bcf-4346-82b2-2d35293885d4 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:11.311033 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-616d009b-8bcf-4346-82b2-2d35293885d4 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:11.311512 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-616d009b-8bcf-4346-82b2-2d35293885d4 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:11.311937 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-616d009b-8bcf-4346-82b2-2d35293885d4 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:11.312615 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-616d009b-8bcf-4346-82b2-2d35293885d4 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:11.313084 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-616d009b-8bcf-4346-82b2-2d35293885d4 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:11.313500 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-616d009b-8bcf-4346-82b2-2d35293885d4 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:11.448668 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-616d009b-8bcf-4346-82b2-2d35293885d4 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:11.458276 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-616d009b-8bcf-4346-82b2-2d35293885d4 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1364 microversion: 2.1 time: 0.158445 Sep 25 04:37:11.459024 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 138/223] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:11 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:12.010183 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-04aaa3ac-4983-4614-80f7-1760a12f25f5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:12.011695 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-04aaa3ac-4983-4614-80f7-1760a12f25f5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:12.015826 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-9cc2e6bb-0f93-4ce7-b775-2b9b0c03a599 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:12.016266 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-9cc2e6bb-0f93-4ce7-b775-2b9b0c03a599 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:12.019067 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-04aaa3ac-4983-4614-80f7-1760a12f25f5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:12.019560 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-04aaa3ac-4983-4614-80f7-1760a12f25f5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:12.019992 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-04aaa3ac-4983-4614-80f7-1760a12f25f5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:12.021003 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-04aaa3ac-4983-4614-80f7-1760a12f25f5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:12.021184 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-04aaa3ac-4983-4614-80f7-1760a12f25f5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:12.021599 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-04aaa3ac-4983-4614-80f7-1760a12f25f5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:12.022052 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9cc2e6bb-0f93-4ce7-b775-2b9b0c03a599 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:12.022531 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9cc2e6bb-0f93-4ce7-b775-2b9b0c03a599 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:12.022964 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9cc2e6bb-0f93-4ce7-b775-2b9b0c03a599 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:12.023653 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9cc2e6bb-0f93-4ce7-b775-2b9b0c03a599 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:12.024424 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9cc2e6bb-0f93-4ce7-b775-2b9b0c03a599 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:12.024530 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9cc2e6bb-0f93-4ce7-b775-2b9b0c03a599 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:12.308340 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-9cc2e6bb-0f93-4ce7-b775-2b9b0c03a599 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:12.310277 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-04aaa3ac-4983-4614-80f7-1760a12f25f5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:12.317084 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-9cc2e6bb-0f93-4ce7-b775-2b9b0c03a599 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1363 microversion: 2.1 time: 0.305806 Sep 25 04:37:12.328755 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 139/224] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:12 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1363 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:37:12.329026 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-04aaa3ac-4983-4614-80f7-1760a12f25f5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.314508 Sep 25 04:37:12.329108 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-3d9f0326-5ddd-4f84-80a3-5406b490638c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:12.329108 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-3d9f0326-5ddd-4f84-80a3-5406b490638c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:12.334890 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3d9f0326-5ddd-4f84-80a3-5406b490638c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:12.335609 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3d9f0326-5ddd-4f84-80a3-5406b490638c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:12.336212 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3d9f0326-5ddd-4f84-80a3-5406b490638c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:12.337105 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3d9f0326-5ddd-4f84-80a3-5406b490638c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:12.337768 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3d9f0326-5ddd-4f84-80a3-5406b490638c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:12.338112 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 86/225] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:12 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:12.339678 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3d9f0326-5ddd-4f84-80a3-5406b490638c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:12.491945 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-8433da1e-7cbd-4260-be09-7f7e67a324cc tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:12.493341 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-8433da1e-7cbd-4260-be09-7f7e67a324cc tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:12.514597 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8433da1e-7cbd-4260-be09-7f7e67a324cc tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:12.516761 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8433da1e-7cbd-4260-be09-7f7e67a324cc tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:12.517209 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8433da1e-7cbd-4260-be09-7f7e67a324cc tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:12.521204 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8433da1e-7cbd-4260-be09-7f7e67a324cc tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:12.522313 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8433da1e-7cbd-4260-be09-7f7e67a324cc tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:12.523126 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8433da1e-7cbd-4260-be09-7f7e67a324cc tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:12.614736 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-3d9f0326-5ddd-4f84-80a3-5406b490638c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:12.626307 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-3d9f0326-5ddd-4f84-80a3-5406b490638c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:12.627844 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-3d9f0326-5ddd-4f84-80a3-5406b490638c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:12.632829 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-3d9f0326-5ddd-4f84-80a3-5406b490638c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1407 microversion: 2.20 time: 0.313511 Sep 25 04:37:12.633424 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 140/226] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:37:12 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1407 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:37:12.765570 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-8433da1e-7cbd-4260-be09-7f7e67a324cc tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:12.774157 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-8433da1e-7cbd-4260-be09-7f7e67a324cc tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1364 microversion: 2.1 time: 0.291142 Sep 25 04:37:12.774720 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 87/227] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:12 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1364 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:13.349740 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-e07c468c-cbfb-482a-96ff-062bd5d6f3ed tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:13.350765 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-e128fd16-88cd-41da-ace7-dac683598f56 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:13.351268 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-e07c468c-cbfb-482a-96ff-062bd5d6f3ed tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:13.352165 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-e128fd16-88cd-41da-ace7-dac683598f56 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:13.362861 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e128fd16-88cd-41da-ace7-dac683598f56 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:13.363361 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e128fd16-88cd-41da-ace7-dac683598f56 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:13.363631 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e07c468c-cbfb-482a-96ff-062bd5d6f3ed tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:13.364212 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e128fd16-88cd-41da-ace7-dac683598f56 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:13.364724 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e07c468c-cbfb-482a-96ff-062bd5d6f3ed tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:13.365284 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e128fd16-88cd-41da-ace7-dac683598f56 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:13.365553 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e07c468c-cbfb-482a-96ff-062bd5d6f3ed tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:13.366051 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e128fd16-88cd-41da-ace7-dac683598f56 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:13.366272 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e07c468c-cbfb-482a-96ff-062bd5d6f3ed tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:13.366716 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e07c468c-cbfb-482a-96ff-062bd5d6f3ed tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:13.367187 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e07c468c-cbfb-482a-96ff-062bd5d6f3ed tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:13.367487 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e128fd16-88cd-41da-ace7-dac683598f56 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:13.630531 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-e07c468c-cbfb-482a-96ff-062bd5d6f3ed tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:13.643685 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-e07c468c-cbfb-482a-96ff-062bd5d6f3ed tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.299711 Sep 25 04:37:13.644308 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 88/228] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:13 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:37:13.652135 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-e128fd16-88cd-41da-ace7-dac683598f56 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:13.664555 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-765031a0-5eeb-4c57-a447-2100bb9a7bad tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:13.665743 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-765031a0-5eeb-4c57-a447-2100bb9a7bad tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:13.672370 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-e128fd16-88cd-41da-ace7-dac683598f56 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1363 microversion: 2.1 time: 0.332149 Sep 25 04:37:13.687176 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 141/229] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:13 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1363 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:13.694953 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-765031a0-5eeb-4c57-a447-2100bb9a7bad tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:13.695554 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-765031a0-5eeb-4c57-a447-2100bb9a7bad tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:13.696060 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-765031a0-5eeb-4c57-a447-2100bb9a7bad tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:13.696893 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-765031a0-5eeb-4c57-a447-2100bb9a7bad tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:13.697417 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-765031a0-5eeb-4c57-a447-2100bb9a7bad tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:13.698060 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-765031a0-5eeb-4c57-a447-2100bb9a7bad tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:13.798419 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-1815fba7-8c89-42ba-a52b-81f54fbb1921 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:13.799444 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-1815fba7-8c89-42ba-a52b-81f54fbb1921 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:13.805990 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1815fba7-8c89-42ba-a52b-81f54fbb1921 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:13.806685 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1815fba7-8c89-42ba-a52b-81f54fbb1921 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:13.807312 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1815fba7-8c89-42ba-a52b-81f54fbb1921 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:13.808015 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1815fba7-8c89-42ba-a52b-81f54fbb1921 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:13.808470 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1815fba7-8c89-42ba-a52b-81f54fbb1921 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:13.809035 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1815fba7-8c89-42ba-a52b-81f54fbb1921 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:13.870391 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-765031a0-5eeb-4c57-a447-2100bb9a7bad tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:13.885251 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-765031a0-5eeb-4c57-a447-2100bb9a7bad tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:13.889330 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-765031a0-5eeb-4c57-a447-2100bb9a7bad tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:13.891107 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-765031a0-5eeb-4c57-a447-2100bb9a7bad tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1407 microversion: 2.20 time: 0.232748 Sep 25 04:37:13.892896 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 89/230] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:37:13 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:37:14.007816 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-1815fba7-8c89-42ba-a52b-81f54fbb1921 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:14.016327 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-1815fba7-8c89-42ba-a52b-81f54fbb1921 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1364 microversion: 2.1 time: 0.221755 Sep 25 04:37:14.017482 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 142/231] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:13 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1364 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:37:14.675350 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-e90ea095-be1e-4d85-8029-cf304edd019b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:14.675994 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-e90ea095-be1e-4d85-8029-cf304edd019b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:14.684753 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e90ea095-be1e-4d85-8029-cf304edd019b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:14.685374 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e90ea095-be1e-4d85-8029-cf304edd019b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:14.685841 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e90ea095-be1e-4d85-8029-cf304edd019b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:14.686905 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e90ea095-be1e-4d85-8029-cf304edd019b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:14.687361 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e90ea095-be1e-4d85-8029-cf304edd019b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:14.687950 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e90ea095-be1e-4d85-8029-cf304edd019b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:14.704967 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-74ad44eb-febc-46d7-b3ea-6204c9259716 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:14.705637 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-74ad44eb-febc-46d7-b3ea-6204c9259716 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:14.712587 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-74ad44eb-febc-46d7-b3ea-6204c9259716 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:14.713292 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-74ad44eb-febc-46d7-b3ea-6204c9259716 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:14.714094 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-74ad44eb-febc-46d7-b3ea-6204c9259716 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:14.715137 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-74ad44eb-febc-46d7-b3ea-6204c9259716 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:14.715887 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-74ad44eb-febc-46d7-b3ea-6204c9259716 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:14.716465 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-74ad44eb-febc-46d7-b3ea-6204c9259716 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:14.928539 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-e90ea095-be1e-4d85-8029-cf304edd019b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:14.938948 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-e90ea095-be1e-4d85-8029-cf304edd019b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.268461 Sep 25 04:37:14.941106 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 90/232] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:14 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:14.947335 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-4e6321f1-5335-4709-98cd-b74d4f61c5ee tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:14.948762 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-4e6321f1-5335-4709-98cd-b74d4f61c5ee tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:14.959670 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4e6321f1-5335-4709-98cd-b74d4f61c5ee tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:14.960092 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4e6321f1-5335-4709-98cd-b74d4f61c5ee tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:14.960623 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4e6321f1-5335-4709-98cd-b74d4f61c5ee tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:14.961573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4e6321f1-5335-4709-98cd-b74d4f61c5ee tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:14.962469 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4e6321f1-5335-4709-98cd-b74d4f61c5ee tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:14.963163 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4e6321f1-5335-4709-98cd-b74d4f61c5ee tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:14.964041 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-74ad44eb-febc-46d7-b3ea-6204c9259716 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:14.968304 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=100 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:14.975712 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-74ad44eb-febc-46d7-b3ea-6204c9259716 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1363 microversion: 2.1 time: 0.277449 Sep 25 04:37:14.976291 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 143/233] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:14 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1363 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:15.040219 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-c610eb65-bde0-4aad-9124-e7b036b5d31f tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:15.040920 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-c610eb65-bde0-4aad-9124-e7b036b5d31f tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:15.049105 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c610eb65-bde0-4aad-9124-e7b036b5d31f tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:15.049802 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c610eb65-bde0-4aad-9124-e7b036b5d31f tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:15.050394 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c610eb65-bde0-4aad-9124-e7b036b5d31f tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:15.051293 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c610eb65-bde0-4aad-9124-e7b036b5d31f tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:15.051915 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c610eb65-bde0-4aad-9124-e7b036b5d31f tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:15.052495 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c610eb65-bde0-4aad-9124-e7b036b5d31f tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:15.151109 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-4e6321f1-5335-4709-98cd-b74d4f61c5ee tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:15.161516 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-4e6321f1-5335-4709-98cd-b74d4f61c5ee tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:15.163574 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-4e6321f1-5335-4709-98cd-b74d4f61c5ee tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:15.164727 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-4e6321f1-5335-4709-98cd-b74d4f61c5ee tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1407 microversion: 2.20 time: 0.222572 Sep 25 04:37:15.165276 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 91/234] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:37:14 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:37:15.230416 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-c610eb65-bde0-4aad-9124-e7b036b5d31f tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:15.238882 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-c610eb65-bde0-4aad-9124-e7b036b5d31f tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1364 microversion: 2.1 time: 0.202337 Sep 25 04:37:15.239481 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 144/235] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:15 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1364 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:37:15.965250 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-fbbd0561-3cfe-4b70-8417-ad95906b7072 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:15.966578 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-fbbd0561-3cfe-4b70-8417-ad95906b7072 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:15.973927 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fbbd0561-3cfe-4b70-8417-ad95906b7072 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:15.974718 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fbbd0561-3cfe-4b70-8417-ad95906b7072 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:15.975160 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fbbd0561-3cfe-4b70-8417-ad95906b7072 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:15.975867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fbbd0561-3cfe-4b70-8417-ad95906b7072 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:15.976503 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fbbd0561-3cfe-4b70-8417-ad95906b7072 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:15.977116 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fbbd0561-3cfe-4b70-8417-ad95906b7072 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:16.001930 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-da938fa9-058b-470a-a51e-9474060b1372 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:16.002542 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-da938fa9-058b-470a-a51e-9474060b1372 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:16.011118 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-da938fa9-058b-470a-a51e-9474060b1372 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:16.012435 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-da938fa9-058b-470a-a51e-9474060b1372 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:16.013651 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-da938fa9-058b-470a-a51e-9474060b1372 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:16.015471 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-da938fa9-058b-470a-a51e-9474060b1372 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:16.016162 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-da938fa9-058b-470a-a51e-9474060b1372 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:16.017214 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-da938fa9-058b-470a-a51e-9474060b1372 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:16.228712 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-fbbd0561-3cfe-4b70-8417-ad95906b7072 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:16.233343 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-da938fa9-058b-470a-a51e-9474060b1372 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:16.237844 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-fbbd0561-3cfe-4b70-8417-ad95906b7072 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.277007 Sep 25 04:37:16.253645 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 92/236] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:15 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:16.263343 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-da938fa9-058b-470a-a51e-9474060b1372 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1363 microversion: 2.1 time: 0.267049 Sep 25 04:37:16.266047 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-ec35e335-3d69-4b50-bab2-ea885e880589 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:16.270685 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-ec35e335-3d69-4b50-bab2-ea885e880589 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:16.279847 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 145/237] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:15 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1363 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:16.287256 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ec35e335-3d69-4b50-bab2-ea885e880589 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:16.287701 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ec35e335-3d69-4b50-bab2-ea885e880589 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:16.288341 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-1f7574ec-8d48-4796-9588-ebacde809684 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:16.289590 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ec35e335-3d69-4b50-bab2-ea885e880589 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:16.290230 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-1f7574ec-8d48-4796-9588-ebacde809684 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:16.292526 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ec35e335-3d69-4b50-bab2-ea885e880589 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:16.295887 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ec35e335-3d69-4b50-bab2-ea885e880589 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:16.295887 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ec35e335-3d69-4b50-bab2-ea885e880589 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:16.303441 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1f7574ec-8d48-4796-9588-ebacde809684 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:16.303935 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1f7574ec-8d48-4796-9588-ebacde809684 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:16.304371 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1f7574ec-8d48-4796-9588-ebacde809684 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:16.305123 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1f7574ec-8d48-4796-9588-ebacde809684 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:16.305556 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1f7574ec-8d48-4796-9588-ebacde809684 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:16.305981 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1f7574ec-8d48-4796-9588-ebacde809684 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:16.584332 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-1f7574ec-8d48-4796-9588-ebacde809684 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:16.600799 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-ec35e335-3d69-4b50-bab2-ea885e880589 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:16.619452 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-ec35e335-3d69-4b50-bab2-ea885e880589 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:16.620935 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-ec35e335-3d69-4b50-bab2-ea885e880589 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:16.622931 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-ec35e335-3d69-4b50-bab2-ea885e880589 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1407 microversion: 2.20 time: 0.383018 Sep 25 04:37:16.626891 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-1f7574ec-8d48-4796-9588-ebacde809684 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1364 microversion: 2.1 time: 0.349538 Sep 25 04:37:16.629539 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 146/238] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:16 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1364 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:16.630044 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 93/239] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:37:16 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1407 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:37:17.284314 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-fe78608a-f8df-421e-b627-6912c2dc8a0b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:17.291780 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-df56c485-a0b3-455a-ab6e-dae13ba1fa2f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:17.295720 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-fe78608a-f8df-421e-b627-6912c2dc8a0b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:17.297965 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-df56c485-a0b3-455a-ab6e-dae13ba1fa2f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:17.315367 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fe78608a-f8df-421e-b627-6912c2dc8a0b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:17.316085 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fe78608a-f8df-421e-b627-6912c2dc8a0b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:17.316517 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fe78608a-f8df-421e-b627-6912c2dc8a0b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:17.320617 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-df56c485-a0b3-455a-ab6e-dae13ba1fa2f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:17.321141 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-df56c485-a0b3-455a-ab6e-dae13ba1fa2f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:17.321589 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-df56c485-a0b3-455a-ab6e-dae13ba1fa2f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:17.322289 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-df56c485-a0b3-455a-ab6e-dae13ba1fa2f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:17.322750 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-df56c485-a0b3-455a-ab6e-dae13ba1fa2f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:17.326711 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fe78608a-f8df-421e-b627-6912c2dc8a0b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:17.327261 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fe78608a-f8df-421e-b627-6912c2dc8a0b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:17.327780 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fe78608a-f8df-421e-b627-6912c2dc8a0b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:17.332056 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-df56c485-a0b3-455a-ab6e-dae13ba1fa2f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:17.640621 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-df56c485-a0b3-455a-ab6e-dae13ba1fa2f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:17.649270 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-df56c485-a0b3-455a-ab6e-dae13ba1fa2f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1363 microversion: 2.1 time: 0.362998 Sep 25 04:37:17.667633 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 94/240] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:17 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1363 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:17.674046 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-8f192f83-8dbc-4a89-af98-838c09bfb337 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:17.674805 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-8f192f83-8dbc-4a89-af98-838c09bfb337 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:17.676289 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-fe78608a-f8df-421e-b627-6912c2dc8a0b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:17.684309 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-fe78608a-f8df-421e-b627-6912c2dc8a0b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.427091 Sep 25 04:37:17.685558 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 147/241] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:17 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:17.686491 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8f192f83-8dbc-4a89-af98-838c09bfb337 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:17.687168 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8f192f83-8dbc-4a89-af98-838c09bfb337 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:17.687592 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8f192f83-8dbc-4a89-af98-838c09bfb337 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:17.688566 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8f192f83-8dbc-4a89-af98-838c09bfb337 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:17.688792 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8f192f83-8dbc-4a89-af98-838c09bfb337 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:17.689499 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8f192f83-8dbc-4a89-af98-838c09bfb337 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:17.702231 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-6ff41940-de89-4277-872c-3df4fcf1a23b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:17.707383 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-6ff41940-de89-4277-872c-3df4fcf1a23b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:17.720488 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6ff41940-de89-4277-872c-3df4fcf1a23b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:17.724016 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6ff41940-de89-4277-872c-3df4fcf1a23b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:17.724958 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6ff41940-de89-4277-872c-3df4fcf1a23b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:17.725839 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6ff41940-de89-4277-872c-3df4fcf1a23b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:17.726302 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6ff41940-de89-4277-872c-3df4fcf1a23b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:17.726911 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6ff41940-de89-4277-872c-3df4fcf1a23b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:17.938846 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-8f192f83-8dbc-4a89-af98-838c09bfb337 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:17.962449 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-6ff41940-de89-4277-872c-3df4fcf1a23b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:17.972538 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-8f192f83-8dbc-4a89-af98-838c09bfb337 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:17.978179 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-6ff41940-de89-4277-872c-3df4fcf1a23b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1364 microversion: 2.1 time: 0.291262 Sep 25 04:37:17.981037 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 148/242] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:17 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1364 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:17.981692 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-8f192f83-8dbc-4a89-af98-838c09bfb337 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:17.983086 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-8f192f83-8dbc-4a89-af98-838c09bfb337 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1407 microversion: 2.20 time: 0.313041 Sep 25 04:37:17.984142 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 95/243] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:37:17 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1407 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:37:18.674807 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-0fe1b261-4cf0-4de3-84f1-66b41e622ddc tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:18.675589 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-0fe1b261-4cf0-4de3-84f1-66b41e622ddc tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:18.686530 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0fe1b261-4cf0-4de3-84f1-66b41e622ddc tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:18.687161 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0fe1b261-4cf0-4de3-84f1-66b41e622ddc tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:18.690901 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0fe1b261-4cf0-4de3-84f1-66b41e622ddc tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:18.691662 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0fe1b261-4cf0-4de3-84f1-66b41e622ddc tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:18.692132 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0fe1b261-4cf0-4de3-84f1-66b41e622ddc tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:18.695050 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0fe1b261-4cf0-4de3-84f1-66b41e622ddc tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:18.709603 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-10860345-bd67-4140-9ef4-082b76f8ce4e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:18.710387 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-10860345-bd67-4140-9ef4-082b76f8ce4e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:18.724658 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-10860345-bd67-4140-9ef4-082b76f8ce4e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:18.725161 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-10860345-bd67-4140-9ef4-082b76f8ce4e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:18.732230 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-10860345-bd67-4140-9ef4-082b76f8ce4e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:18.733244 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-10860345-bd67-4140-9ef4-082b76f8ce4e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:18.737369 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-10860345-bd67-4140-9ef4-082b76f8ce4e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:18.739125 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-10860345-bd67-4140-9ef4-082b76f8ce4e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:18.956348 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-0fe1b261-4cf0-4de3-84f1-66b41e622ddc tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:18.977800 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-0fe1b261-4cf0-4de3-84f1-66b41e622ddc tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1363 microversion: 2.1 time: 0.307612 Sep 25 04:37:18.995551 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 149/244] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:18 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1363 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:19.008328 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-033b4c9c-0720-4882-8a95-63a79291356d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:19.008963 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-033b4c9c-0720-4882-8a95-63a79291356d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:19.021138 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-033b4c9c-0720-4882-8a95-63a79291356d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:19.022293 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-033b4c9c-0720-4882-8a95-63a79291356d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:19.022719 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-033b4c9c-0720-4882-8a95-63a79291356d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:19.043282 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-033b4c9c-0720-4882-8a95-63a79291356d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:19.043955 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-033b4c9c-0720-4882-8a95-63a79291356d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:19.044435 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-033b4c9c-0720-4882-8a95-63a79291356d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:19.070560 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-10860345-bd67-4140-9ef4-082b76f8ce4e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:19.079346 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-10860345-bd67-4140-9ef4-082b76f8ce4e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.374069 Sep 25 04:37:19.085694 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 96/245] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:18 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:37:19.107416 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-f3a67e0a-5448-4864-bd46-34b7eae64ebc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:19.110803 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-f3a67e0a-5448-4864-bd46-34b7eae64ebc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:19.125543 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f3a67e0a-5448-4864-bd46-34b7eae64ebc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:19.128186 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f3a67e0a-5448-4864-bd46-34b7eae64ebc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:19.128804 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f3a67e0a-5448-4864-bd46-34b7eae64ebc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:19.129636 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f3a67e0a-5448-4864-bd46-34b7eae64ebc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:19.132919 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f3a67e0a-5448-4864-bd46-34b7eae64ebc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:19.133436 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f3a67e0a-5448-4864-bd46-34b7eae64ebc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:19.340516 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-033b4c9c-0720-4882-8a95-63a79291356d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:19.348188 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-033b4c9c-0720-4882-8a95-63a79291356d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1364 microversion: 2.1 time: 0.346232 Sep 25 04:37:19.352144 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 150/246] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:19 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1364 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:19.381555 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-f3a67e0a-5448-4864-bd46-34b7eae64ebc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:19.400785 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-f3a67e0a-5448-4864-bd46-34b7eae64ebc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:19.402601 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-f3a67e0a-5448-4864-bd46-34b7eae64ebc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:19.404534 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-f3a67e0a-5448-4864-bd46-34b7eae64ebc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1407 microversion: 2.20 time: 0.303522 Sep 25 04:37:19.405350 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 97/247] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:37:19 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1407 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:37:20.004497 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-4717c31c-e925-4bec-95c0-b5be88a2140e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:20.005749 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-4717c31c-e925-4bec-95c0-b5be88a2140e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:20.017391 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4717c31c-e925-4bec-95c0-b5be88a2140e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:20.019541 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4717c31c-e925-4bec-95c0-b5be88a2140e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:20.021501 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4717c31c-e925-4bec-95c0-b5be88a2140e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:20.022394 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4717c31c-e925-4bec-95c0-b5be88a2140e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:20.025917 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4717c31c-e925-4bec-95c0-b5be88a2140e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:20.026552 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4717c31c-e925-4bec-95c0-b5be88a2140e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:20.115654 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-b1f495c8-e360-4d4c-80b9-a76bae77b07b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:20.117272 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-b1f495c8-e360-4d4c-80b9-a76bae77b07b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:20.132355 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b1f495c8-e360-4d4c-80b9-a76bae77b07b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:20.134212 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b1f495c8-e360-4d4c-80b9-a76bae77b07b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:20.134824 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b1f495c8-e360-4d4c-80b9-a76bae77b07b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:20.138110 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b1f495c8-e360-4d4c-80b9-a76bae77b07b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:20.139069 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b1f495c8-e360-4d4c-80b9-a76bae77b07b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:20.142522 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b1f495c8-e360-4d4c-80b9-a76bae77b07b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:20.279712 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-4717c31c-e925-4bec-95c0-b5be88a2140e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:20.306101 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-4717c31c-e925-4bec-95c0-b5be88a2140e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1363 microversion: 2.1 time: 0.306697 Sep 25 04:37:20.306908 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 151/248] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:19 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1363 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:20.311542 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-d6e53e13-5342-4ad1-ac57-6acd24abc750 req-5d4abdd1-fc05-4a83-b548-4eef0eb56e86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a31d3c84-7c72-4a2c-970c-b58e15f431f1", "name": "network-vif-plugged", "status": "completed", "tag": "02bb815d-6dec-4eac-9221-50f10407403b"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:37:20.363234 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-d6e53e13-5342-4ad1-ac57-6acd24abc750 req-5d4abdd1-fc05-4a83-b548-4eef0eb56e86 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:20.365183 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-d6e53e13-5342-4ad1-ac57-6acd24abc750 req-5d4abdd1-fc05-4a83-b548-4eef0eb56e86 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:20.365471 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-d6e53e13-5342-4ad1-ac57-6acd24abc750 req-5d4abdd1-fc05-4a83-b548-4eef0eb56e86 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:20.396516 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-d6e53e13-5342-4ad1-ac57-6acd24abc750 req-5d4abdd1-fc05-4a83-b548-4eef0eb56e86 service nova] Creating event network-vif-plugged:02bb815d-6dec-4eac-9221-50f10407403b for instance a31d3c84-7c72-4a2c-970c-b58e15f431f1 on hv-cinder-85535 Sep 25 04:37:20.404567 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-d6e53e13-5342-4ad1-ac57-6acd24abc750 req-5d4abdd1-fc05-4a83-b548-4eef0eb56e86 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096151 Sep 25 04:37:20.406188 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 152/249] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:37:20.413177 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-e53d01cd-5a32-4556-bfcb-a95a9107e5d7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:20.414486 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-e53d01cd-5a32-4556-bfcb-a95a9107e5d7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:20.426637 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e53d01cd-5a32-4556-bfcb-a95a9107e5d7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:20.427137 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e53d01cd-5a32-4556-bfcb-a95a9107e5d7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:20.427759 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e53d01cd-5a32-4556-bfcb-a95a9107e5d7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:20.428599 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e53d01cd-5a32-4556-bfcb-a95a9107e5d7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:20.444681 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e53d01cd-5a32-4556-bfcb-a95a9107e5d7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:20.445888 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e53d01cd-5a32-4556-bfcb-a95a9107e5d7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:20.700530 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-b1f495c8-e360-4d4c-80b9-a76bae77b07b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:20.713308 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-b1f495c8-e360-4d4c-80b9-a76bae77b07b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.602094 Sep 25 04:37:20.713901 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 98/250] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:20 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:20.736863 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-3e3b5a0a-0399-4cd2-af7d-a32301f377d5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:20.738505 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-3e3b5a0a-0399-4cd2-af7d-a32301f377d5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:20.756117 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3e3b5a0a-0399-4cd2-af7d-a32301f377d5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:20.757156 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3e3b5a0a-0399-4cd2-af7d-a32301f377d5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:20.757862 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3e3b5a0a-0399-4cd2-af7d-a32301f377d5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:20.758797 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3e3b5a0a-0399-4cd2-af7d-a32301f377d5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:20.759684 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3e3b5a0a-0399-4cd2-af7d-a32301f377d5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:20.760486 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3e3b5a0a-0399-4cd2-af7d-a32301f377d5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:20.824121 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-e53d01cd-5a32-4556-bfcb-a95a9107e5d7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:20.833186 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-e53d01cd-5a32-4556-bfcb-a95a9107e5d7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1551 microversion: 2.1 time: 0.425160 Sep 25 04:37:20.833783 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 153/251] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:20 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1551 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:20.871815 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-987f571a-4ed2-4f51-8d99-521b948b291a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:20.873260 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-987f571a-4ed2-4f51-8d99-521b948b291a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:20.890289 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-987f571a-4ed2-4f51-8d99-521b948b291a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:20.891065 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-987f571a-4ed2-4f51-8d99-521b948b291a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:20.891512 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-987f571a-4ed2-4f51-8d99-521b948b291a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:20.892258 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-987f571a-4ed2-4f51-8d99-521b948b291a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:20.892740 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-987f571a-4ed2-4f51-8d99-521b948b291a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:20.893172 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-987f571a-4ed2-4f51-8d99-521b948b291a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:21.009540 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-3e3b5a0a-0399-4cd2-af7d-a32301f377d5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:21.018354 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-3e3b5a0a-0399-4cd2-af7d-a32301f377d5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:21.019800 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-3e3b5a0a-0399-4cd2-af7d-a32301f377d5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:21.020967 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-3e3b5a0a-0399-4cd2-af7d-a32301f377d5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1407 microversion: 2.20 time: 0.306098 Sep 25 04:37:21.038911 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 99/252] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:37:20 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1407 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:37:21.051024 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-987f571a-4ed2-4f51-8d99-521b948b291a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.187637 Sep 25 04:37:21.052573 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 154/253] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Sep 25 04:37:20 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632/os-interface => generated 285 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:37:21.332239 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-03c769f2-98cf-4fcb-a932-74b9a264d850 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:21.334089 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-03c769f2-98cf-4fcb-a932-74b9a264d850 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:21.351348 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-03c769f2-98cf-4fcb-a932-74b9a264d850 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:21.353514 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-03c769f2-98cf-4fcb-a932-74b9a264d850 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:21.356927 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-03c769f2-98cf-4fcb-a932-74b9a264d850 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:21.357695 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-03c769f2-98cf-4fcb-a932-74b9a264d850 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:21.358168 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-03c769f2-98cf-4fcb-a932-74b9a264d850 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:21.360567 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-03c769f2-98cf-4fcb-a932-74b9a264d850 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:21.696468 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-03c769f2-98cf-4fcb-a932-74b9a264d850 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:21.708474 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-03c769f2-98cf-4fcb-a932-74b9a264d850 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1363 microversion: 2.1 time: 0.382513 Sep 25 04:37:21.728300 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 100/254] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:21 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1363 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:21.738260 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-9ef4896d-4fd5-486e-b098-f15fac632a97 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:21.738874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-9ef4896d-4fd5-486e-b098-f15fac632a97 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:21.770815 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9ef4896d-4fd5-486e-b098-f15fac632a97 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:21.771323 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9ef4896d-4fd5-486e-b098-f15fac632a97 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:21.773529 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9ef4896d-4fd5-486e-b098-f15fac632a97 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:21.774760 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9ef4896d-4fd5-486e-b098-f15fac632a97 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:21.776051 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9ef4896d-4fd5-486e-b098-f15fac632a97 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:21.777507 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9ef4896d-4fd5-486e-b098-f15fac632a97 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:22.050522 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-c295e761-ddd4-40bd-9276-e47d7b0f50c5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:22.051131 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-c295e761-ddd4-40bd-9276-e47d7b0f50c5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:22.072549 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c295e761-ddd4-40bd-9276-e47d7b0f50c5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:22.073636 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c295e761-ddd4-40bd-9276-e47d7b0f50c5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:22.074779 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c295e761-ddd4-40bd-9276-e47d7b0f50c5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:22.076317 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c295e761-ddd4-40bd-9276-e47d7b0f50c5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:22.076982 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c295e761-ddd4-40bd-9276-e47d7b0f50c5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:22.077397 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c295e761-ddd4-40bd-9276-e47d7b0f50c5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:22.322748 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-9ef4896d-4fd5-486e-b098-f15fac632a97 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:22.337979 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-9ef4896d-4fd5-486e-b098-f15fac632a97 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.600814 Sep 25 04:37:22.338585 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 155/255] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:21 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:22.419517 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-c295e761-ddd4-40bd-9276-e47d7b0f50c5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:22.431307 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=100 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:22.450217 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-c295e761-ddd4-40bd-9276-e47d7b0f50c5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:22.457057 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-c295e761-ddd4-40bd-9276-e47d7b0f50c5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:22.459575 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-c295e761-ddd4-40bd-9276-e47d7b0f50c5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1407 microversion: 2.20 time: 0.412297 Sep 25 04:37:22.460832 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 101/256] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:37:22 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1407 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:37:22.750119 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-147b6110-1ca0-407a-8049-c4e12bc780c0 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:22.750876 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-147b6110-1ca0-407a-8049-c4e12bc780c0 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:22.757076 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-147b6110-1ca0-407a-8049-c4e12bc780c0 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:22.757810 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-147b6110-1ca0-407a-8049-c4e12bc780c0 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:22.758355 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-147b6110-1ca0-407a-8049-c4e12bc780c0 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:22.759174 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-147b6110-1ca0-407a-8049-c4e12bc780c0 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:22.759865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-147b6110-1ca0-407a-8049-c4e12bc780c0 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:22.760503 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-147b6110-1ca0-407a-8049-c4e12bc780c0 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:23.127852 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-147b6110-1ca0-407a-8049-c4e12bc780c0 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:23.142787 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-147b6110-1ca0-407a-8049-c4e12bc780c0 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1363 microversion: 2.1 time: 0.397145 Sep 25 04:37:23.149915 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [req-73d2f583-d54b-4480-89e9-51097b20e0f6 req-efbc97bd-8d2f-4452-8c9e-a518e3666654 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9be0143-7c91-4fba-8c2c-500f01573632", "tag": "352ac3fb-d005-4e6e-98b0-7339ef6c2202"}]} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:37:23.158705 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 156/257] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:22 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1363 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:23.176544 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-73d2f583-d54b-4480-89e9-51097b20e0f6 req-efbc97bd-8d2f-4452-8c9e-a518e3666654 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:23.179978 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-73d2f583-d54b-4480-89e9-51097b20e0f6 req-efbc97bd-8d2f-4452-8c9e-a518e3666654 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:23.181786 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-73d2f583-d54b-4480-89e9-51097b20e0f6 req-efbc97bd-8d2f-4452-8c9e-a518e3666654 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:23.195530 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.compute.server_external_events [req-73d2f583-d54b-4480-89e9-51097b20e0f6 req-efbc97bd-8d2f-4452-8c9e-a518e3666654 service nova] Creating event network-changed:352ac3fb-d005-4e6e-98b0-7339ef6c2202 for instance c9be0143-7c91-4fba-8c2c-500f01573632 on hv-cinder-85535 Sep 25 04:37:23.201098 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [req-73d2f583-d54b-4480-89e9-51097b20e0f6 req-efbc97bd-8d2f-4452-8c9e-a518e3666654 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056103 Sep 25 04:37:23.201903 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 102/258] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 04:37:23.369912 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-158dfb6b-0270-42fb-bebb-604a9e86809c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:23.372227 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-158dfb6b-0270-42fb-bebb-604a9e86809c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:23.380111 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-158dfb6b-0270-42fb-bebb-604a9e86809c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:23.381240 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-158dfb6b-0270-42fb-bebb-604a9e86809c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:23.382564 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-158dfb6b-0270-42fb-bebb-604a9e86809c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:23.383491 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-158dfb6b-0270-42fb-bebb-604a9e86809c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:23.384721 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-158dfb6b-0270-42fb-bebb-604a9e86809c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:23.385485 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-158dfb6b-0270-42fb-bebb-604a9e86809c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:23.489499 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-5108091f-6310-4db0-9e28-0c5dae98f9ef tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:23.490756 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-5108091f-6310-4db0-9e28-0c5dae98f9ef tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:23.508784 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5108091f-6310-4db0-9e28-0c5dae98f9ef tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:23.513484 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5108091f-6310-4db0-9e28-0c5dae98f9ef tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:23.514339 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5108091f-6310-4db0-9e28-0c5dae98f9ef tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:23.515492 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5108091f-6310-4db0-9e28-0c5dae98f9ef tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:23.520433 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5108091f-6310-4db0-9e28-0c5dae98f9ef tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:23.520921 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5108091f-6310-4db0-9e28-0c5dae98f9ef tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:23.642835 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-158dfb6b-0270-42fb-bebb-604a9e86809c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:23.653720 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-158dfb6b-0270-42fb-bebb-604a9e86809c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.290051 Sep 25 04:37:23.680783 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 157/259] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:23 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:23.810379 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-5108091f-6310-4db0-9e28-0c5dae98f9ef tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:23.823810 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-5108091f-6310-4db0-9e28-0c5dae98f9ef tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:23.828358 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-5108091f-6310-4db0-9e28-0c5dae98f9ef tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:23.829575 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-5108091f-6310-4db0-9e28-0c5dae98f9ef tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1407 microversion: 2.20 time: 0.345630 Sep 25 04:37:23.835640 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 103/260] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:37:23 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1407 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:37:24.188535 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-c426b8fb-ec53-4180-b6e1-d37adcf646d8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:24.189533 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-c426b8fb-ec53-4180-b6e1-d37adcf646d8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:24.198092 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c426b8fb-ec53-4180-b6e1-d37adcf646d8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:24.198661 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c426b8fb-ec53-4180-b6e1-d37adcf646d8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:24.200008 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c426b8fb-ec53-4180-b6e1-d37adcf646d8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:24.201291 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c426b8fb-ec53-4180-b6e1-d37adcf646d8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:24.202449 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c426b8fb-ec53-4180-b6e1-d37adcf646d8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:24.203034 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c426b8fb-ec53-4180-b6e1-d37adcf646d8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:24.398146 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-c426b8fb-ec53-4180-b6e1-d37adcf646d8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:24.409138 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-c426b8fb-ec53-4180-b6e1-d37adcf646d8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1363 microversion: 2.1 time: 0.226440 Sep 25 04:37:24.422279 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 158/261] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:24 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:24.681043 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-f83e6986-c123-48fd-822f-559df10fbcd0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:24.681658 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-f83e6986-c123-48fd-822f-559df10fbcd0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:24.695997 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f83e6986-c123-48fd-822f-559df10fbcd0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:24.696523 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f83e6986-c123-48fd-822f-559df10fbcd0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:24.697001 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f83e6986-c123-48fd-822f-559df10fbcd0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:24.697727 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f83e6986-c123-48fd-822f-559df10fbcd0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:24.698184 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f83e6986-c123-48fd-822f-559df10fbcd0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:24.698612 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f83e6986-c123-48fd-822f-559df10fbcd0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:24.865191 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-a8211283-c840-421d-9426-1fe9147aab72 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:24.866218 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-a8211283-c840-421d-9426-1fe9147aab72 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:24.879294 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-f83e6986-c123-48fd-822f-559df10fbcd0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:24.880014 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a8211283-c840-421d-9426-1fe9147aab72 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:24.880825 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a8211283-c840-421d-9426-1fe9147aab72 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:24.883698 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a8211283-c840-421d-9426-1fe9147aab72 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:24.885363 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a8211283-c840-421d-9426-1fe9147aab72 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:24.886543 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a8211283-c840-421d-9426-1fe9147aab72 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:24.887288 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a8211283-c840-421d-9426-1fe9147aab72 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:24.888896 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-f83e6986-c123-48fd-822f-559df10fbcd0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.211605 Sep 25 04:37:24.889822 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 104/262] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:24 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:25.055156 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-a8211283-c840-421d-9426-1fe9147aab72 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:25.066027 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-a8211283-c840-421d-9426-1fe9147aab72 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:25.067534 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-a8211283-c840-421d-9426-1fe9147aab72 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:25.068892 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-a8211283-c840-421d-9426-1fe9147aab72 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1407 microversion: 2.20 time: 0.211915 Sep 25 04:37:25.070103 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 159/263] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:37:24 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 04:37:25.452719 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-daff532d-e357-4952-a4ea-739b36593676 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:25.453107 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-daff532d-e357-4952-a4ea-739b36593676 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:25.482559 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-daff532d-e357-4952-a4ea-739b36593676 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:25.485506 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-daff532d-e357-4952-a4ea-739b36593676 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:25.486153 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-daff532d-e357-4952-a4ea-739b36593676 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:25.487531 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-daff532d-e357-4952-a4ea-739b36593676 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:25.489493 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-daff532d-e357-4952-a4ea-739b36593676 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:25.490948 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-daff532d-e357-4952-a4ea-739b36593676 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:25.812428 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-daff532d-e357-4952-a4ea-739b36593676 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:25.843142 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-daff532d-e357-4952-a4ea-739b36593676 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1363 microversion: 2.1 time: 0.404727 Sep 25 04:37:25.856662 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 105/264] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:25 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1363 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:25.912454 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-0f3a7a39-a313-4636-a043-f8a4ba2cc0c9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:25.913204 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-0f3a7a39-a313-4636-a043-f8a4ba2cc0c9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:25.922626 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0f3a7a39-a313-4636-a043-f8a4ba2cc0c9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:25.923496 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0f3a7a39-a313-4636-a043-f8a4ba2cc0c9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:25.924587 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0f3a7a39-a313-4636-a043-f8a4ba2cc0c9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:25.926150 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0f3a7a39-a313-4636-a043-f8a4ba2cc0c9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:25.926772 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0f3a7a39-a313-4636-a043-f8a4ba2cc0c9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:25.928384 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0f3a7a39-a313-4636-a043-f8a4ba2cc0c9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:26.100558 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-86717c13-923f-40dc-857d-ea747b0de3a7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:26.101462 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-86717c13-923f-40dc-857d-ea747b0de3a7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:26.109487 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-86717c13-923f-40dc-857d-ea747b0de3a7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:26.110981 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-86717c13-923f-40dc-857d-ea747b0de3a7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:26.111422 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-86717c13-923f-40dc-857d-ea747b0de3a7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:26.113462 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-86717c13-923f-40dc-857d-ea747b0de3a7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:26.116107 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-86717c13-923f-40dc-857d-ea747b0de3a7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:26.116889 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-86717c13-923f-40dc-857d-ea747b0de3a7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:26.140802 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-0f3a7a39-a313-4636-a043-f8a4ba2cc0c9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:26.150072 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-0f3a7a39-a313-4636-a043-f8a4ba2cc0c9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.242471 Sep 25 04:37:26.164664 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 160/265] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:25 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:26.330889 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-86717c13-923f-40dc-857d-ea747b0de3a7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:26.340966 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-86717c13-923f-40dc-857d-ea747b0de3a7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:26.342864 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-86717c13-923f-40dc-857d-ea747b0de3a7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:26.344041 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-86717c13-923f-40dc-857d-ea747b0de3a7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1407 microversion: 2.20 time: 0.250880 Sep 25 04:37:26.344605 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 106/266] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:37:26 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1407 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 04:37:26.870106 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-0974f645-1f98-4432-b2df-5a4b2d923f0d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:26.871286 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-0974f645-1f98-4432-b2df-5a4b2d923f0d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:26.878713 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0974f645-1f98-4432-b2df-5a4b2d923f0d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:26.879448 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0974f645-1f98-4432-b2df-5a4b2d923f0d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:26.880238 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0974f645-1f98-4432-b2df-5a4b2d923f0d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:26.881445 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0974f645-1f98-4432-b2df-5a4b2d923f0d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:26.882040 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0974f645-1f98-4432-b2df-5a4b2d923f0d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:26.882717 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0974f645-1f98-4432-b2df-5a4b2d923f0d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:26.941209 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=100 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:27.178943 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-4631ce79-76c5-477f-924b-e47e242934b0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:27.179723 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-4631ce79-76c5-477f-924b-e47e242934b0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:27.194829 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4631ce79-76c5-477f-924b-e47e242934b0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:27.195323 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4631ce79-76c5-477f-924b-e47e242934b0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:27.195755 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4631ce79-76c5-477f-924b-e47e242934b0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:27.196451 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4631ce79-76c5-477f-924b-e47e242934b0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:27.197097 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4631ce79-76c5-477f-924b-e47e242934b0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:27.197675 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4631ce79-76c5-477f-924b-e47e242934b0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:27.239217 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-0974f645-1f98-4432-b2df-5a4b2d923f0d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:27.269761 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-0974f645-1f98-4432-b2df-5a4b2d923f0d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1363 microversion: 2.1 time: 0.407251 Sep 25 04:37:27.270662 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 161/267] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:26 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1363 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:27.376239 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-345045b3-1658-4a91-a3ce-781cc31c31a1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:27.376879 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-345045b3-1658-4a91-a3ce-781cc31c31a1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:27.391462 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-345045b3-1658-4a91-a3ce-781cc31c31a1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:27.391962 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-345045b3-1658-4a91-a3ce-781cc31c31a1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:27.392811 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-345045b3-1658-4a91-a3ce-781cc31c31a1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:27.393233 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-345045b3-1658-4a91-a3ce-781cc31c31a1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:27.393689 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-345045b3-1658-4a91-a3ce-781cc31c31a1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:27.394181 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-345045b3-1658-4a91-a3ce-781cc31c31a1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:27.420994 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-4631ce79-76c5-477f-924b-e47e242934b0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:27.431280 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-4631ce79-76c5-477f-924b-e47e242934b0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.257343 Sep 25 04:37:27.435818 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 107/268] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:27 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:27.647605 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-345045b3-1658-4a91-a3ce-781cc31c31a1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:27.664578 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-345045b3-1658-4a91-a3ce-781cc31c31a1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:27.666851 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-345045b3-1658-4a91-a3ce-781cc31c31a1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:27.669337 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-345045b3-1658-4a91-a3ce-781cc31c31a1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1407 microversion: 2.20 time: 0.299609 Sep 25 04:37:27.670601 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 162/269] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:37:27 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1407 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 04:37:28.190472 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-910f1e48-13cd-4c62-82ca-13cc6e95948f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Action: 'create', calling method: .version_select at 0x7f4d3f0aba60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-363590622", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGd00jvEDGjF0lt/OYu69DcCrp6qQ7WfCNez8E3bUIzNmoH9lZZcijJHftUGT75BEOswTOg8RCsFnZqaKAc0Z4zjz+lTtu9kbSQzSlBlbc6kIkwObM6n4h0TWD1rT/eYg=="}} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:37:28.207094 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.quota [None req-910f1e48-13cd-4c62-82ca-13cc6e95948f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Getting quotas for project 00f66d2c942b419abc8d9d010c5a57f3. Resources: {'key_pairs'} {{(pid=127141) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 04:37:28.211629 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.quota [None req-910f1e48-13cd-4c62-82ca-13cc6e95948f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Getting quotas for user 329e3f9810b648218dd45a8b489adb1d and project 00f66d2c942b419abc8d9d010c5a57f3. Resources: {'key_pairs'} {{(pid=127141) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 04:37:28.255013 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-910f1e48-13cd-4c62-82ca-13cc6e95948f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.291013 Sep 25 04:37:28.256424 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 108/270] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 25 04:37:27 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:37:28.298910 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-f0673d95-d62f-464a-8bf3-52486a33e6e2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:28.300156 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-f0673d95-d62f-464a-8bf3-52486a33e6e2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:28.309837 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f0673d95-d62f-464a-8bf3-52486a33e6e2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:28.314513 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f0673d95-d62f-464a-8bf3-52486a33e6e2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:28.315285 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f0673d95-d62f-464a-8bf3-52486a33e6e2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:28.320583 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f0673d95-d62f-464a-8bf3-52486a33e6e2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:28.323388 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f0673d95-d62f-464a-8bf3-52486a33e6e2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:28.325662 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f0673d95-d62f-464a-8bf3-52486a33e6e2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:28.463352 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-55d1fb2f-b3a8-4577-ae86-c8df9e60ede4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:28.464130 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-55d1fb2f-b3a8-4577-ae86-c8df9e60ede4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:28.471404 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=1 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:28.475095 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-55d1fb2f-b3a8-4577-ae86-c8df9e60ede4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:28.475895 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-55d1fb2f-b3a8-4577-ae86-c8df9e60ede4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:28.477479 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-55d1fb2f-b3a8-4577-ae86-c8df9e60ede4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:28.479413 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-55d1fb2f-b3a8-4577-ae86-c8df9e60ede4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:28.480312 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-55d1fb2f-b3a8-4577-ae86-c8df9e60ede4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:28.481176 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-55d1fb2f-b3a8-4577-ae86-c8df9e60ede4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:28.857133 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-f0673d95-d62f-464a-8bf3-52486a33e6e2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:28.876772 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-f0673d95-d62f-464a-8bf3-52486a33e6e2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1363 microversion: 2.1 time: 0.582121 Sep 25 04:37:28.878039 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 163/271] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:28 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1363 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:28.883225 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-3d860533-23e5-48f2-b706-c5833aa14e21 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:28.884922 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-3d860533-23e5-48f2-b706-c5833aa14e21 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:28.893524 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3d860533-23e5-48f2-b706-c5833aa14e21 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:28.894464 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3d860533-23e5-48f2-b706-c5833aa14e21 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:28.895154 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3d860533-23e5-48f2-b706-c5833aa14e21 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:28.896200 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3d860533-23e5-48f2-b706-c5833aa14e21 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:28.896901 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3d860533-23e5-48f2-b706-c5833aa14e21 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:28.900135 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3d860533-23e5-48f2-b706-c5833aa14e21 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:28.910547 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-55d1fb2f-b3a8-4577-ae86-c8df9e60ede4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:28.929209 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-55d1fb2f-b3a8-4577-ae86-c8df9e60ede4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.470165 Sep 25 04:37:28.929839 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 109/272] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:28 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:37:29.093715 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-3d860533-23e5-48f2-b706-c5833aa14e21 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:29.105742 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-3d860533-23e5-48f2-b706-c5833aa14e21 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:29.108018 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-3d860533-23e5-48f2-b706-c5833aa14e21 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:29.109737 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-3d860533-23e5-48f2-b706-c5833aa14e21 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1407 microversion: 2.20 time: 0.230530 Sep 25 04:37:29.110519 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 164/273] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:37:28 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:37:29.907333 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-315fdac7-af6e-4eff-901e-096e5d6646b4 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:29.907998 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-315fdac7-af6e-4eff-901e-096e5d6646b4 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:29.926455 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-315fdac7-af6e-4eff-901e-096e5d6646b4 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:29.926966 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-315fdac7-af6e-4eff-901e-096e5d6646b4 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:29.927402 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-315fdac7-af6e-4eff-901e-096e5d6646b4 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:29.930685 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-315fdac7-af6e-4eff-901e-096e5d6646b4 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:29.932757 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-315fdac7-af6e-4eff-901e-096e5d6646b4 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:29.934255 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-315fdac7-af6e-4eff-901e-096e5d6646b4 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:29.956256 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-002997a3-0a14-4388-bff1-5d72a13a2a1b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:29.956725 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-002997a3-0a14-4388-bff1-5d72a13a2a1b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:29.967731 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_api:SELECT=100 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:29.969239 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-002997a3-0a14-4388-bff1-5d72a13a2a1b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:29.980343 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-002997a3-0a14-4388-bff1-5d72a13a2a1b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:29.981396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-002997a3-0a14-4388-bff1-5d72a13a2a1b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:29.988968 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-002997a3-0a14-4388-bff1-5d72a13a2a1b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:29.993439 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-002997a3-0a14-4388-bff1-5d72a13a2a1b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:29.994066 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-002997a3-0a14-4388-bff1-5d72a13a2a1b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:30.478753 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-002997a3-0a14-4388-bff1-5d72a13a2a1b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:30.490263 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-315fdac7-af6e-4eff-901e-096e5d6646b4 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:30.506236 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-315fdac7-af6e-4eff-901e-096e5d6646b4 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1363 microversion: 2.1 time: 0.604567 Sep 25 04:37:30.508020 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-002997a3-0a14-4388-bff1-5d72a13a2a1b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.557848 Sep 25 04:37:30.509583 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 110/274] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:29 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1363 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:30.511154 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 165/275] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:29 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:37:30.524977 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-59d2d558-bc56-434f-bdd2-0fc88774b7c4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:30.526661 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-4ac1a2bf-94a0-4e2a-bc64-29b436addee6 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:30.527192 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-4ac1a2bf-94a0-4e2a-bc64-29b436addee6 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:30.529383 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-59d2d558-bc56-434f-bdd2-0fc88774b7c4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:30.538626 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4ac1a2bf-94a0-4e2a-bc64-29b436addee6 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:30.539327 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4ac1a2bf-94a0-4e2a-bc64-29b436addee6 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:30.539926 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4ac1a2bf-94a0-4e2a-bc64-29b436addee6 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:30.540817 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4ac1a2bf-94a0-4e2a-bc64-29b436addee6 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:30.541419 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4ac1a2bf-94a0-4e2a-bc64-29b436addee6 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:30.541840 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4ac1a2bf-94a0-4e2a-bc64-29b436addee6 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:30.559600 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-59d2d558-bc56-434f-bdd2-0fc88774b7c4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:30.560099 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-59d2d558-bc56-434f-bdd2-0fc88774b7c4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:30.560535 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-59d2d558-bc56-434f-bdd2-0fc88774b7c4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:30.561367 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-59d2d558-bc56-434f-bdd2-0fc88774b7c4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:30.561995 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-59d2d558-bc56-434f-bdd2-0fc88774b7c4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:30.562593 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-59d2d558-bc56-434f-bdd2-0fc88774b7c4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:30.583535 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-4ac1a2bf-94a0-4e2a-bc64-29b436addee6 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Going to try to terminate instance {{(pid=127142) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 04:37:30.767967 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-4ac1a2bf-94a0-4e2a-bc64-29b436addee6 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 204 len: 0 microversion: 2.1 time: 0.254644 Sep 25 04:37:30.768749 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 166/276] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 25 04:37:30 2022] DELETE /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 04:37:30.782863 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-20c2641d-1076-463a-8fd6-a36ad7b87b04 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:30.784549 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-20c2641d-1076-463a-8fd6-a36ad7b87b04 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:30.800335 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-20c2641d-1076-463a-8fd6-a36ad7b87b04 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:30.801740 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-20c2641d-1076-463a-8fd6-a36ad7b87b04 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:30.803346 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-20c2641d-1076-463a-8fd6-a36ad7b87b04 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:30.804089 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-20c2641d-1076-463a-8fd6-a36ad7b87b04 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:30.804565 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-20c2641d-1076-463a-8fd6-a36ad7b87b04 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:30.805766 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-20c2641d-1076-463a-8fd6-a36ad7b87b04 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:30.806361 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-59d2d558-bc56-434f-bdd2-0fc88774b7c4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:30.821370 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-59d2d558-bc56-434f-bdd2-0fc88774b7c4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:30.826390 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-59d2d558-bc56-434f-bdd2-0fc88774b7c4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:30.828111 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-59d2d558-bc56-434f-bdd2-0fc88774b7c4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1599 microversion: 2.20 time: 0.317076 Sep 25 04:37:30.828978 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 111/277] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:37:30 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1599 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:37:30.857700 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-d5bf8352-ad04-44a0-b91a-8303b9963ed9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:30.858176 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-d5bf8352-ad04-44a0-b91a-8303b9963ed9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:30.868753 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d5bf8352-ad04-44a0-b91a-8303b9963ed9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:30.868889 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d5bf8352-ad04-44a0-b91a-8303b9963ed9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:30.872116 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d5bf8352-ad04-44a0-b91a-8303b9963ed9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:30.873178 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d5bf8352-ad04-44a0-b91a-8303b9963ed9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:30.873666 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d5bf8352-ad04-44a0-b91a-8303b9963ed9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:30.874252 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d5bf8352-ad04-44a0-b91a-8303b9963ed9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:31.018660 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-d5bf8352-ad04-44a0-b91a-8303b9963ed9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.165427 Sep 25 04:37:31.019400 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 112/278] 10.222.0.25 () {60 vars in 1316 bytes} [Sun Sep 25 04:37:30 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14/os-interface => generated 284 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 04:37:31.094047 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-20c2641d-1076-463a-8fd6-a36ad7b87b04 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:31.107567 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-20c2641d-1076-463a-8fd6-a36ad7b87b04 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1553 microversion: 2.1 time: 0.329276 Sep 25 04:37:31.108580 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 167/279] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:30 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1553 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:31.532369 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-951bc8c2-0be3-43b0-84d6-2dc55012adf6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:31.533417 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-951bc8c2-0be3-43b0-84d6-2dc55012adf6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:31.534582 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-a4f15fcf-9ccb-46f7-9a12-078cc4b46eeb tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:31.535295 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-a4f15fcf-9ccb-46f7-9a12-078cc4b46eeb tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:31.543295 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a4f15fcf-9ccb-46f7-9a12-078cc4b46eeb tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:31.544969 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a4f15fcf-9ccb-46f7-9a12-078cc4b46eeb tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:31.546086 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a4f15fcf-9ccb-46f7-9a12-078cc4b46eeb tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:31.547898 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a4f15fcf-9ccb-46f7-9a12-078cc4b46eeb tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:31.548516 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-951bc8c2-0be3-43b0-84d6-2dc55012adf6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:31.549058 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-951bc8c2-0be3-43b0-84d6-2dc55012adf6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:31.549495 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-951bc8c2-0be3-43b0-84d6-2dc55012adf6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:31.549689 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a4f15fcf-9ccb-46f7-9a12-078cc4b46eeb tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:31.550193 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-951bc8c2-0be3-43b0-84d6-2dc55012adf6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:31.550644 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-951bc8c2-0be3-43b0-84d6-2dc55012adf6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:31.554226 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-951bc8c2-0be3-43b0-84d6-2dc55012adf6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:31.554869 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a4f15fcf-9ccb-46f7-9a12-078cc4b46eeb tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:31.860770 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-a4f15fcf-9ccb-46f7-9a12-078cc4b46eeb tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:31.874703 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-a4f15fcf-9ccb-46f7-9a12-078cc4b46eeb tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.339542 Sep 25 04:37:31.878340 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 168/280] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:31 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:37:31.882817 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-951bc8c2-0be3-43b0-84d6-2dc55012adf6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:31.919474 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-951bc8c2-0be3-43b0-84d6-2dc55012adf6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1363 microversion: 2.1 time: 0.377186 Sep 25 04:37:31.947382 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 113/281] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:31 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1363 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:32.134079 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-1e7c9586-1082-4dbc-b7a6-dae56552513d tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:32.134696 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-1e7c9586-1082-4dbc-b7a6-dae56552513d tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:32.147116 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1e7c9586-1082-4dbc-b7a6-dae56552513d tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:32.147614 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1e7c9586-1082-4dbc-b7a6-dae56552513d tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:32.148047 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1e7c9586-1082-4dbc-b7a6-dae56552513d tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:32.148942 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1e7c9586-1082-4dbc-b7a6-dae56552513d tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:32.149400 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1e7c9586-1082-4dbc-b7a6-dae56552513d tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:32.151235 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1e7c9586-1082-4dbc-b7a6-dae56552513d tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:32.370047 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-1e7c9586-1082-4dbc-b7a6-dae56552513d tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:32.380218 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-1e7c9586-1082-4dbc-b7a6-dae56552513d tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1553 microversion: 2.1 time: 0.250043 Sep 25 04:37:32.398118 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 169/282] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:32 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1553 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:32.901102 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-cb8fc1eb-2e58-460f-9ebf-06c7bb29efbc tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:32.901809 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-cb8fc1eb-2e58-460f-9ebf-06c7bb29efbc tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:32.924331 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cb8fc1eb-2e58-460f-9ebf-06c7bb29efbc tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:32.925875 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cb8fc1eb-2e58-460f-9ebf-06c7bb29efbc tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:32.926896 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cb8fc1eb-2e58-460f-9ebf-06c7bb29efbc tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:32.928439 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cb8fc1eb-2e58-460f-9ebf-06c7bb29efbc tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:32.929622 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cb8fc1eb-2e58-460f-9ebf-06c7bb29efbc tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:32.930424 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cb8fc1eb-2e58-460f-9ebf-06c7bb29efbc tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:32.954658 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-793b5126-a99d-4237-9c75-96e46f50ac78 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:32.955621 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-793b5126-a99d-4237-9c75-96e46f50ac78 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:32.963411 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-793b5126-a99d-4237-9c75-96e46f50ac78 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:32.969164 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-793b5126-a99d-4237-9c75-96e46f50ac78 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:32.971157 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-793b5126-a99d-4237-9c75-96e46f50ac78 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:32.973629 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-793b5126-a99d-4237-9c75-96e46f50ac78 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:32.974290 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-793b5126-a99d-4237-9c75-96e46f50ac78 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:32.977803 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-793b5126-a99d-4237-9c75-96e46f50ac78 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:33.256442 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-cb8fc1eb-2e58-460f-9ebf-06c7bb29efbc tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:33.260175 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-793b5126-a99d-4237-9c75-96e46f50ac78 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:33.270041 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-cb8fc1eb-2e58-460f-9ebf-06c7bb29efbc tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.372316 Sep 25 04:37:33.280670 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 114/283] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:32 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:33.281470 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [req-41bffaf1-0e5b-4e8c-a5e5-5b7f97ead975 req-669c4cda-01c0-45bc-bc3a-b1b984147739 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9e99419-ae76-4d84-9e7a-d0a31530ea14", "tag": "28807ae7-bb46-4e31-93d7-48170864edca"}]} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:37:33.292986 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-793b5126-a99d-4237-9c75-96e46f50ac78 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1363 microversion: 2.1 time: 0.341512 Sep 25 04:37:33.294336 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 170/284] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:32 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1363 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:37:33.299065 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-41bffaf1-0e5b-4e8c-a5e5-5b7f97ead975 req-669c4cda-01c0-45bc-bc3a-b1b984147739 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:33.299672 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-41bffaf1-0e5b-4e8c-a5e5-5b7f97ead975 req-669c4cda-01c0-45bc-bc3a-b1b984147739 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:33.300225 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-41bffaf1-0e5b-4e8c-a5e5-5b7f97ead975 req-669c4cda-01c0-45bc-bc3a-b1b984147739 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:33.320202 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.compute.server_external_events [req-41bffaf1-0e5b-4e8c-a5e5-5b7f97ead975 req-669c4cda-01c0-45bc-bc3a-b1b984147739 service nova] Creating event network-changed:28807ae7-bb46-4e31-93d7-48170864edca for instance c9e99419-ae76-4d84-9e7a-d0a31530ea14 on hv-cinder-85535 Sep 25 04:37:33.326975 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [req-41bffaf1-0e5b-4e8c-a5e5-5b7f97ead975 req-669c4cda-01c0-45bc-bc3a-b1b984147739 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053474 Sep 25 04:37:33.327864 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 115/285] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:37:33.409183 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-77aff6ba-8e3f-4ba6-b109-cd5dd952e455 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:33.410144 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-77aff6ba-8e3f-4ba6-b109-cd5dd952e455 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:33.419876 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-77aff6ba-8e3f-4ba6-b109-cd5dd952e455 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:33.420565 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-77aff6ba-8e3f-4ba6-b109-cd5dd952e455 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:33.421332 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-77aff6ba-8e3f-4ba6-b109-cd5dd952e455 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:33.424709 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-77aff6ba-8e3f-4ba6-b109-cd5dd952e455 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:33.427292 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-77aff6ba-8e3f-4ba6-b109-cd5dd952e455 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:33.427964 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-77aff6ba-8e3f-4ba6-b109-cd5dd952e455 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:33.624932 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-77aff6ba-8e3f-4ba6-b109-cd5dd952e455 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:33.636691 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-77aff6ba-8e3f-4ba6-b109-cd5dd952e455 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1553 microversion: 2.1 time: 0.234051 Sep 25 04:37:33.638868 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 171/286] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:33 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1553 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:34.301769 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-2208b251-d54d-4df1-95f2-fe3669335c97 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:34.302650 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-2208b251-d54d-4df1-95f2-fe3669335c97 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:34.310407 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2208b251-d54d-4df1-95f2-fe3669335c97 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:34.310911 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2208b251-d54d-4df1-95f2-fe3669335c97 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:34.311346 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2208b251-d54d-4df1-95f2-fe3669335c97 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:34.312106 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2208b251-d54d-4df1-95f2-fe3669335c97 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:34.312572 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2208b251-d54d-4df1-95f2-fe3669335c97 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:34.313233 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2208b251-d54d-4df1-95f2-fe3669335c97 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:34.322676 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-046cbb18-04a8-49e5-a444-f97e94e47e73 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:34.324935 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-046cbb18-04a8-49e5-a444-f97e94e47e73 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:34.334467 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-046cbb18-04a8-49e5-a444-f97e94e47e73 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:34.335590 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-046cbb18-04a8-49e5-a444-f97e94e47e73 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:34.336276 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-046cbb18-04a8-49e5-a444-f97e94e47e73 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:34.337392 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-046cbb18-04a8-49e5-a444-f97e94e47e73 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:34.338153 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-046cbb18-04a8-49e5-a444-f97e94e47e73 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:34.338762 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-046cbb18-04a8-49e5-a444-f97e94e47e73 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:34.688137 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-2208b251-d54d-4df1-95f2-fe3669335c97 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:34.693403 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-046cbb18-04a8-49e5-a444-f97e94e47e73 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:34.703572 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-2208b251-d54d-4df1-95f2-fe3669335c97 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.410518 Sep 25 04:37:34.704459 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 116/287] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:34 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:34.709838 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-97f8b215-7b75-405b-84e7-24ccc463786a tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:34.711211 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-97f8b215-7b75-405b-84e7-24ccc463786a tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:34.712241 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-046cbb18-04a8-49e5-a444-f97e94e47e73 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1363 microversion: 2.1 time: 0.394185 Sep 25 04:37:34.717796 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-97f8b215-7b75-405b-84e7-24ccc463786a tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:34.718496 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-97f8b215-7b75-405b-84e7-24ccc463786a tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:34.719329 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-97f8b215-7b75-405b-84e7-24ccc463786a tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:34.724894 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-97f8b215-7b75-405b-84e7-24ccc463786a tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:34.725657 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-97f8b215-7b75-405b-84e7-24ccc463786a tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:34.726109 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-97f8b215-7b75-405b-84e7-24ccc463786a tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:34.729363 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 172/288] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:34 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1363 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:34.885950 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-97f8b215-7b75-405b-84e7-24ccc463786a tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:34.895307 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-97f8b215-7b75-405b-84e7-24ccc463786a tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1553 microversion: 2.1 time: 0.189636 Sep 25 04:37:34.895891 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 117/289] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:34 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1553 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:35.729113 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-4bde01be-2aa9-4818-b318-43c3202323b5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:35.729739 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-4bde01be-2aa9-4818-b318-43c3202323b5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:35.740850 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-4c209bfd-72a7-4578-adfe-f1bec02d18aa tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:35.742147 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-4c209bfd-72a7-4578-adfe-f1bec02d18aa tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:35.751811 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4bde01be-2aa9-4818-b318-43c3202323b5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:35.752332 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4bde01be-2aa9-4818-b318-43c3202323b5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:35.752816 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4bde01be-2aa9-4818-b318-43c3202323b5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:35.753511 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4bde01be-2aa9-4818-b318-43c3202323b5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:35.754336 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4bde01be-2aa9-4818-b318-43c3202323b5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:35.754434 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4bde01be-2aa9-4818-b318-43c3202323b5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:35.762108 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4c209bfd-72a7-4578-adfe-f1bec02d18aa tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:35.762911 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4c209bfd-72a7-4578-adfe-f1bec02d18aa tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:35.763351 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4c209bfd-72a7-4578-adfe-f1bec02d18aa tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:35.764045 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4c209bfd-72a7-4578-adfe-f1bec02d18aa tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:35.764701 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4c209bfd-72a7-4578-adfe-f1bec02d18aa tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:35.766962 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4c209bfd-72a7-4578-adfe-f1bec02d18aa tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:36.020435 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-4bde01be-2aa9-4818-b318-43c3202323b5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:36.027327 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-4c209bfd-72a7-4578-adfe-f1bec02d18aa tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:36.031159 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-4bde01be-2aa9-4818-b318-43c3202323b5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.306265 Sep 25 04:37:36.032270 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 173/290] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:35 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:36.038334 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-e5ecd319-ef15-4166-9572-5c967009b4c5 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:36.041123 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-e5ecd319-ef15-4166-9572-5c967009b4c5 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:36.050233 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e5ecd319-ef15-4166-9572-5c967009b4c5 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:36.052091 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e5ecd319-ef15-4166-9572-5c967009b4c5 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:36.052888 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e5ecd319-ef15-4166-9572-5c967009b4c5 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:36.053509 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-4c209bfd-72a7-4578-adfe-f1bec02d18aa tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1554 microversion: 2.1 time: 0.319449 Sep 25 04:37:36.054403 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e5ecd319-ef15-4166-9572-5c967009b4c5 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:36.056230 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e5ecd319-ef15-4166-9572-5c967009b4c5 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:36.057208 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e5ecd319-ef15-4166-9572-5c967009b4c5 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:36.072463 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 118/291] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:35 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1554 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:36.091802 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-669f290a-d59d-427d-b4f6-eccf5343df7a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:36.092441 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-669f290a-d59d-427d-b4f6-eccf5343df7a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:36.100725 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-669f290a-d59d-427d-b4f6-eccf5343df7a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:36.101391 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-669f290a-d59d-427d-b4f6-eccf5343df7a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:36.101988 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-669f290a-d59d-427d-b4f6-eccf5343df7a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:36.103035 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-669f290a-d59d-427d-b4f6-eccf5343df7a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:36.103490 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-669f290a-d59d-427d-b4f6-eccf5343df7a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:36.104033 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-669f290a-d59d-427d-b4f6-eccf5343df7a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:36.232393 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-669f290a-d59d-427d-b4f6-eccf5343df7a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.158382 Sep 25 04:37:36.235057 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 119/292] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Sep 25 04:37:36 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1/os-interface => generated 285 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 04:37:36.310768 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-e5ecd319-ef15-4166-9572-5c967009b4c5 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:36.319316 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-e5ecd319-ef15-4166-9572-5c967009b4c5 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1553 microversion: 2.1 time: 0.285801 Sep 25 04:37:36.322243 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 174/293] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:36 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1553 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:37.060997 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-c7be44f5-d441-4557-b4b1-0139e9d41507 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:37.062237 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-c7be44f5-d441-4557-b4b1-0139e9d41507 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:37.068380 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c7be44f5-d441-4557-b4b1-0139e9d41507 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:37.069090 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c7be44f5-d441-4557-b4b1-0139e9d41507 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:37.069484 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c7be44f5-d441-4557-b4b1-0139e9d41507 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:37.070580 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c7be44f5-d441-4557-b4b1-0139e9d41507 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:37.071097 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c7be44f5-d441-4557-b4b1-0139e9d41507 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:37.071587 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c7be44f5-d441-4557-b4b1-0139e9d41507 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:37.215541 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-c7be44f5-d441-4557-b4b1-0139e9d41507 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:37.226146 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-c7be44f5-d441-4557-b4b1-0139e9d41507 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.170180 Sep 25 04:37:37.226885 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 120/294] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:37 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:37.262574 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-28fa882f-4b2b-470c-811a-501ba780d90d req-3d36eec6-4833-4c38-96ae-6ee96d11c388 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a31d3c84-7c72-4a2c-970c-b58e15f431f1", "tag": "02bb815d-6dec-4eac-9221-50f10407403b"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:37:37.272140 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-28fa882f-4b2b-470c-811a-501ba780d90d req-3d36eec6-4833-4c38-96ae-6ee96d11c388 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:37.272620 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-28fa882f-4b2b-470c-811a-501ba780d90d req-3d36eec6-4833-4c38-96ae-6ee96d11c388 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:37.273251 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-28fa882f-4b2b-470c-811a-501ba780d90d req-3d36eec6-4833-4c38-96ae-6ee96d11c388 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:37.285970 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-28fa882f-4b2b-470c-811a-501ba780d90d req-3d36eec6-4833-4c38-96ae-6ee96d11c388 service nova] Creating event network-changed:02bb815d-6dec-4eac-9221-50f10407403b for instance a31d3c84-7c72-4a2c-970c-b58e15f431f1 on hv-cinder-85535 Sep 25 04:37:37.291035 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-28fa882f-4b2b-470c-811a-501ba780d90d req-3d36eec6-4833-4c38-96ae-6ee96d11c388 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032538 Sep 25 04:37:37.291616 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 175/295] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:37:37.346286 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-c0e0b129-548d-474b-8cff-71fe04204e17 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:37.346899 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-c0e0b129-548d-474b-8cff-71fe04204e17 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:37.352913 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c0e0b129-548d-474b-8cff-71fe04204e17 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:37.353403 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c0e0b129-548d-474b-8cff-71fe04204e17 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:37.353844 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c0e0b129-548d-474b-8cff-71fe04204e17 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:37.354542 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c0e0b129-548d-474b-8cff-71fe04204e17 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:37.355597 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c0e0b129-548d-474b-8cff-71fe04204e17 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:37.356222 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c0e0b129-548d-474b-8cff-71fe04204e17 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:37.375540 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=100 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:37.494696 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-c0e0b129-548d-474b-8cff-71fe04204e17 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:37.509984 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-c0e0b129-548d-474b-8cff-71fe04204e17 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1553 microversion: 2.1 time: 0.167504 Sep 25 04:37:37.510712 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 121/296] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:37 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:38.257205 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-b933f15d-f9c5-4d31-9ee9-b355bf9cff32 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:38.258200 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-b933f15d-f9c5-4d31-9ee9-b355bf9cff32 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:38.278545 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b933f15d-f9c5-4d31-9ee9-b355bf9cff32 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:38.280281 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b933f15d-f9c5-4d31-9ee9-b355bf9cff32 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:38.282680 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b933f15d-f9c5-4d31-9ee9-b355bf9cff32 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:38.294918 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b933f15d-f9c5-4d31-9ee9-b355bf9cff32 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:38.295867 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b933f15d-f9c5-4d31-9ee9-b355bf9cff32 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:38.298923 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b933f15d-f9c5-4d31-9ee9-b355bf9cff32 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:38.534553 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-d5ed84f9-8a56-4f98-bf08-5df536266d2d tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:38.535168 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-d5ed84f9-8a56-4f98-bf08-5df536266d2d tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:38.537809 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell0:SELECT=4 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:38.551496 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d5ed84f9-8a56-4f98-bf08-5df536266d2d tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:38.556331 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d5ed84f9-8a56-4f98-bf08-5df536266d2d tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:38.557189 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d5ed84f9-8a56-4f98-bf08-5df536266d2d tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:38.558823 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d5ed84f9-8a56-4f98-bf08-5df536266d2d tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:38.581792 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d5ed84f9-8a56-4f98-bf08-5df536266d2d tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:38.582518 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d5ed84f9-8a56-4f98-bf08-5df536266d2d tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:38.661231 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-b933f15d-f9c5-4d31-9ee9-b355bf9cff32 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:38.686970 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-b933f15d-f9c5-4d31-9ee9-b355bf9cff32 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.439847 Sep 25 04:37:38.687564 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 176/297] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:38 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:38.785481 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-d5ed84f9-8a56-4f98-bf08-5df536266d2d tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:38.799857 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-d5ed84f9-8a56-4f98-bf08-5df536266d2d tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1511 microversion: 2.1 time: 0.268916 Sep 25 04:37:38.800886 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 122/298] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:38 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1511 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:39.307030 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-77648eb5-e5d3-42e4-b952-afa6e0dc712d req-a899abf8-44af-4c70-8880-c1f8db82f2dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4dfff9d-4fc4-4f36-aab0-786607ac2cd2", "name": "network-vif-deleted", "tag": "f2950532-6a9f-448f-9801-43583bcb904e"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:37:39.318639 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-77648eb5-e5d3-42e4-b952-afa6e0dc712d req-a899abf8-44af-4c70-8880-c1f8db82f2dc service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:39.319113 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-77648eb5-e5d3-42e4-b952-afa6e0dc712d req-a899abf8-44af-4c70-8880-c1f8db82f2dc service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:39.319532 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-77648eb5-e5d3-42e4-b952-afa6e0dc712d req-a899abf8-44af-4c70-8880-c1f8db82f2dc service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:39.323395 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:39.331491 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-77648eb5-e5d3-42e4-b952-afa6e0dc712d req-a899abf8-44af-4c70-8880-c1f8db82f2dc service nova] Creating event network-vif-deleted:f2950532-6a9f-448f-9801-43583bcb904e for instance f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 on hv-cinder-85535 Sep 25 04:37:39.337072 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-77648eb5-e5d3-42e4-b952-afa6e0dc712d req-a899abf8-44af-4c70-8880-c1f8db82f2dc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033667 Sep 25 04:37:39.337823 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 177/299] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:37:39.711776 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-ab69674c-d034-4bd4-971f-3fcabf07c720 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:39.712424 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-ab69674c-d034-4bd4-971f-3fcabf07c720 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:39.719163 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ab69674c-d034-4bd4-971f-3fcabf07c720 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:39.719659 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ab69674c-d034-4bd4-971f-3fcabf07c720 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:39.720116 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ab69674c-d034-4bd4-971f-3fcabf07c720 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:39.721055 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ab69674c-d034-4bd4-971f-3fcabf07c720 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:39.721549 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ab69674c-d034-4bd4-971f-3fcabf07c720 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:39.722003 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ab69674c-d034-4bd4-971f-3fcabf07c720 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:39.826402 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-b6621a46-68d5-4195-9817-5330014b1349 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:39.827354 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-b6621a46-68d5-4195-9817-5330014b1349 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:39.834757 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b6621a46-68d5-4195-9817-5330014b1349 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:39.836439 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b6621a46-68d5-4195-9817-5330014b1349 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:39.837395 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b6621a46-68d5-4195-9817-5330014b1349 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:39.838683 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b6621a46-68d5-4195-9817-5330014b1349 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:39.839791 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b6621a46-68d5-4195-9817-5330014b1349 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:39.840585 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b6621a46-68d5-4195-9817-5330014b1349 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:39.874177 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-ab69674c-d034-4bd4-971f-3fcabf07c720 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:39.882217 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-ab69674c-d034-4bd4-971f-3fcabf07c720 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.175035 Sep 25 04:37:39.882794 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 123/300] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:39 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:39.914834 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-b6621a46-68d5-4195-9817-5330014b1349 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:39.924124 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-b6621a46-68d5-4195-9817-5330014b1349 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1345 microversion: 2.1 time: 0.103326 Sep 25 04:37:39.924684 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 178/301] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:39 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1345 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:40.907567 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-79e9839d-63ae-4fc2-bdf7-b3f1f5b6aa65 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:40.908175 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-79e9839d-63ae-4fc2-bdf7-b3f1f5b6aa65 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:40.914718 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-79e9839d-63ae-4fc2-bdf7-b3f1f5b6aa65 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:40.915205 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-79e9839d-63ae-4fc2-bdf7-b3f1f5b6aa65 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:40.915672 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-79e9839d-63ae-4fc2-bdf7-b3f1f5b6aa65 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:40.916354 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-79e9839d-63ae-4fc2-bdf7-b3f1f5b6aa65 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:40.916837 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-79e9839d-63ae-4fc2-bdf7-b3f1f5b6aa65 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:40.917485 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-79e9839d-63ae-4fc2-bdf7-b3f1f5b6aa65 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:40.947239 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-a40fdf58-bae8-4f29-b9e5-18be4be7f02e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:40.947887 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-a40fdf58-bae8-4f29-b9e5-18be4be7f02e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:40.954798 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a40fdf58-bae8-4f29-b9e5-18be4be7f02e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:40.955292 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a40fdf58-bae8-4f29-b9e5-18be4be7f02e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:40.955730 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a40fdf58-bae8-4f29-b9e5-18be4be7f02e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:40.956436 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a40fdf58-bae8-4f29-b9e5-18be4be7f02e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:40.956913 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a40fdf58-bae8-4f29-b9e5-18be4be7f02e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:40.957343 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a40fdf58-bae8-4f29-b9e5-18be4be7f02e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:41.071006 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-79e9839d-63ae-4fc2-bdf7-b3f1f5b6aa65 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:41.080497 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-79e9839d-63ae-4fc2-bdf7-b3f1f5b6aa65 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.176904 Sep 25 04:37:41.081250 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 124/302] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:40 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:41.159431 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-a40fdf58-bae8-4f29-b9e5-18be4be7f02e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:41.169020 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-a40fdf58-bae8-4f29-b9e5-18be4be7f02e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1345 microversion: 2.1 time: 0.225586 Sep 25 04:37:41.169587 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 179/303] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:40 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1345 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:37:42.104433 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-2d2d32c9-bc7e-4bd7-a1ea-cde3b479f0c9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:42.105093 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-2d2d32c9-bc7e-4bd7-a1ea-cde3b479f0c9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:42.111475 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2d2d32c9-bc7e-4bd7-a1ea-cde3b479f0c9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:42.111963 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2d2d32c9-bc7e-4bd7-a1ea-cde3b479f0c9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:42.112400 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2d2d32c9-bc7e-4bd7-a1ea-cde3b479f0c9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:42.113126 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2d2d32c9-bc7e-4bd7-a1ea-cde3b479f0c9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:42.113591 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2d2d32c9-bc7e-4bd7-a1ea-cde3b479f0c9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:42.114020 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2d2d32c9-bc7e-4bd7-a1ea-cde3b479f0c9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:42.192288 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-0446b8d3-2ee5-4f9d-8c22-e2398387a470 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:42.192984 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-0446b8d3-2ee5-4f9d-8c22-e2398387a470 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:42.200223 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0446b8d3-2ee5-4f9d-8c22-e2398387a470 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:42.200742 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0446b8d3-2ee5-4f9d-8c22-e2398387a470 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:42.201186 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0446b8d3-2ee5-4f9d-8c22-e2398387a470 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:42.201897 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0446b8d3-2ee5-4f9d-8c22-e2398387a470 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:42.202379 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0446b8d3-2ee5-4f9d-8c22-e2398387a470 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:42.202806 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0446b8d3-2ee5-4f9d-8c22-e2398387a470 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:42.269313 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-0446b8d3-2ee5-4f9d-8c22-e2398387a470 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:42.278078 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-0446b8d3-2ee5-4f9d-8c22-e2398387a470 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1345 microversion: 2.1 time: 0.089908 Sep 25 04:37:42.278640 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 180/304] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:42 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1345 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:37:42.383514 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-2d2d32c9-bc7e-4bd7-a1ea-cde3b479f0c9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:42.391712 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-2d2d32c9-bc7e-4bd7-a1ea-cde3b479f0c9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.291219 Sep 25 04:37:42.392302 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 125/305] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:42 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:43.300075 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-70017235-74a5-4e97-945c-7e352dff39ac tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:43.300706 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-70017235-74a5-4e97-945c-7e352dff39ac tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:43.306668 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-70017235-74a5-4e97-945c-7e352dff39ac tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:43.307165 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-70017235-74a5-4e97-945c-7e352dff39ac tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:43.307603 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-70017235-74a5-4e97-945c-7e352dff39ac tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:43.308992 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-70017235-74a5-4e97-945c-7e352dff39ac tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:43.309448 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-70017235-74a5-4e97-945c-7e352dff39ac tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:43.309873 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-70017235-74a5-4e97-945c-7e352dff39ac tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:43.373407 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-70017235-74a5-4e97-945c-7e352dff39ac tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:43.381672 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-70017235-74a5-4e97-945c-7e352dff39ac tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1345 microversion: 2.1 time: 0.085464 Sep 25 04:37:43.382232 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 181/306] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:43 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1345 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:43.415422 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-56e6385a-39c4-4420-8830-88dc42d0a88b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:43.416088 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-56e6385a-39c4-4420-8830-88dc42d0a88b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:43.423398 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-56e6385a-39c4-4420-8830-88dc42d0a88b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:43.423899 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-56e6385a-39c4-4420-8830-88dc42d0a88b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:43.424341 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-56e6385a-39c4-4420-8830-88dc42d0a88b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:43.425078 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-56e6385a-39c4-4420-8830-88dc42d0a88b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:43.425538 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-56e6385a-39c4-4420-8830-88dc42d0a88b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:43.425965 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-56e6385a-39c4-4420-8830-88dc42d0a88b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:43.563712 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-56e6385a-39c4-4420-8830-88dc42d0a88b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:43.571643 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-56e6385a-39c4-4420-8830-88dc42d0a88b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.160134 Sep 25 04:37:43.572204 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 126/307] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:43 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:44.405357 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-98e78ca9-33b3-4754-9f89-fec68bf15996 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:44.405980 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-98e78ca9-33b3-4754-9f89-fec68bf15996 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:44.412056 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-98e78ca9-33b3-4754-9f89-fec68bf15996 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:44.412550 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-98e78ca9-33b3-4754-9f89-fec68bf15996 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:44.413015 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-98e78ca9-33b3-4754-9f89-fec68bf15996 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:44.413706 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-98e78ca9-33b3-4754-9f89-fec68bf15996 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:44.414153 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-98e78ca9-33b3-4754-9f89-fec68bf15996 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:44.414573 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-98e78ca9-33b3-4754-9f89-fec68bf15996 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:44.477069 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-98e78ca9-33b3-4754-9f89-fec68bf15996 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:44.485734 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-98e78ca9-33b3-4754-9f89-fec68bf15996 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1345 microversion: 2.1 time: 0.084923 Sep 25 04:37:44.486297 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 182/308] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:44 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1345 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:44.595348 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-cd2806bd-f017-4144-93ec-e46c42515f7f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:44.595964 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-cd2806bd-f017-4144-93ec-e46c42515f7f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:44.608627 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cd2806bd-f017-4144-93ec-e46c42515f7f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:44.609151 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cd2806bd-f017-4144-93ec-e46c42515f7f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:44.609582 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cd2806bd-f017-4144-93ec-e46c42515f7f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:44.610310 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cd2806bd-f017-4144-93ec-e46c42515f7f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:44.610759 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cd2806bd-f017-4144-93ec-e46c42515f7f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:44.611178 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cd2806bd-f017-4144-93ec-e46c42515f7f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:44.744114 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-cd2806bd-f017-4144-93ec-e46c42515f7f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:44.753055 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-cd2806bd-f017-4144-93ec-e46c42515f7f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.161413 Sep 25 04:37:44.753640 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 127/309] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:44 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:45.507100 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-472ef60c-5987-41fe-87f3-152f2ed067ba tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:45.507702 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-472ef60c-5987-41fe-87f3-152f2ed067ba tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:45.514094 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-472ef60c-5987-41fe-87f3-152f2ed067ba tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:45.514571 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-472ef60c-5987-41fe-87f3-152f2ed067ba tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:45.515003 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-472ef60c-5987-41fe-87f3-152f2ed067ba tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:45.515677 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-472ef60c-5987-41fe-87f3-152f2ed067ba tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:45.516124 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-472ef60c-5987-41fe-87f3-152f2ed067ba tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:45.516540 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-472ef60c-5987-41fe-87f3-152f2ed067ba tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:45.578092 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-472ef60c-5987-41fe-87f3-152f2ed067ba tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:45.587619 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-472ef60c-5987-41fe-87f3-152f2ed067ba tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1345 microversion: 2.1 time: 0.084211 Sep 25 04:37:45.588188 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 183/310] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:45 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1345 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:45.778278 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-d145b9b7-0ec0-4e7b-918a-f75be48f5f57 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:45.778797 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-d145b9b7-0ec0-4e7b-918a-f75be48f5f57 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:45.785196 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d145b9b7-0ec0-4e7b-918a-f75be48f5f57 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:45.785674 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d145b9b7-0ec0-4e7b-918a-f75be48f5f57 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:45.786103 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d145b9b7-0ec0-4e7b-918a-f75be48f5f57 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:45.786778 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d145b9b7-0ec0-4e7b-918a-f75be48f5f57 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:45.787226 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d145b9b7-0ec0-4e7b-918a-f75be48f5f57 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:45.787643 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d145b9b7-0ec0-4e7b-918a-f75be48f5f57 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:45.924382 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-d145b9b7-0ec0-4e7b-918a-f75be48f5f57 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:45.932118 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-d145b9b7-0ec0-4e7b-918a-f75be48f5f57 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.158726 Sep 25 04:37:45.932796 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 128/311] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:45 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:46.611332 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-56e01730-0a6d-4414-93aa-a3ac8f597973 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:46.611942 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-56e01730-0a6d-4414-93aa-a3ac8f597973 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:46.617962 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-56e01730-0a6d-4414-93aa-a3ac8f597973 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:46.618482 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-56e01730-0a6d-4414-93aa-a3ac8f597973 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:46.618901 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-56e01730-0a6d-4414-93aa-a3ac8f597973 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:46.619562 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-56e01730-0a6d-4414-93aa-a3ac8f597973 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:46.620012 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-56e01730-0a6d-4414-93aa-a3ac8f597973 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:46.620582 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-56e01730-0a6d-4414-93aa-a3ac8f597973 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:46.681541 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-56e01730-0a6d-4414-93aa-a3ac8f597973 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:46.689697 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-56e01730-0a6d-4414-93aa-a3ac8f597973 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1345 microversion: 2.1 time: 0.082331 Sep 25 04:37:46.690255 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 184/312] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:46 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1345 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:46.955532 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-38a8016e-5ce5-42c4-bfba-7f53ffee596a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:46.956137 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-38a8016e-5ce5-42c4-bfba-7f53ffee596a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:46.963347 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-38a8016e-5ce5-42c4-bfba-7f53ffee596a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:46.963847 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-38a8016e-5ce5-42c4-bfba-7f53ffee596a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:46.964311 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-38a8016e-5ce5-42c4-bfba-7f53ffee596a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:46.965045 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-38a8016e-5ce5-42c4-bfba-7f53ffee596a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:46.965507 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-38a8016e-5ce5-42c4-bfba-7f53ffee596a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:46.965946 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-38a8016e-5ce5-42c4-bfba-7f53ffee596a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:47.099727 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-38a8016e-5ce5-42c4-bfba-7f53ffee596a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:47.107532 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-38a8016e-5ce5-42c4-bfba-7f53ffee596a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.155836 Sep 25 04:37:47.108325 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 129/313] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:46 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:47.715239 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-143535de-bebc-4e83-a9ce-42ec6a571277 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:47.715861 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-143535de-bebc-4e83-a9ce-42ec6a571277 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:47.722164 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-143535de-bebc-4e83-a9ce-42ec6a571277 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:47.722827 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-143535de-bebc-4e83-a9ce-42ec6a571277 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:47.723532 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-143535de-bebc-4e83-a9ce-42ec6a571277 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:47.724236 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-143535de-bebc-4e83-a9ce-42ec6a571277 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:47.724726 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-143535de-bebc-4e83-a9ce-42ec6a571277 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:47.725317 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-143535de-bebc-4e83-a9ce-42ec6a571277 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:47.772614 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-143535de-bebc-4e83-a9ce-42ec6a571277 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:47.778290 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-143535de-bebc-4e83-a9ce-42ec6a571277 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:47.781838 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-143535de-bebc-4e83-a9ce-42ec6a571277 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:47.782590 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.objects.instance [None req-143535de-bebc-4e83-a9ce-42ec6a571277 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lazy-loading 'fault' on Instance uuid f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 {{(pid=127142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 04:37:47.860204 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-143535de-bebc-4e83-a9ce-42ec6a571277 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:47.869105 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-143535de-bebc-4e83-a9ce-42ec6a571277 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1350 microversion: 2.1 time: 0.158929 Sep 25 04:37:47.869796 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 185/314] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:47 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1350 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:37:48.131410 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-939e16ae-2ed6-4700-8f3c-aea71c53b902 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:48.132029 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-939e16ae-2ed6-4700-8f3c-aea71c53b902 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:48.139541 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-939e16ae-2ed6-4700-8f3c-aea71c53b902 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:48.140027 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-939e16ae-2ed6-4700-8f3c-aea71c53b902 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:48.140466 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-939e16ae-2ed6-4700-8f3c-aea71c53b902 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:48.141207 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-939e16ae-2ed6-4700-8f3c-aea71c53b902 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:48.141662 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-939e16ae-2ed6-4700-8f3c-aea71c53b902 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:48.142086 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-939e16ae-2ed6-4700-8f3c-aea71c53b902 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:48.281096 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-939e16ae-2ed6-4700-8f3c-aea71c53b902 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:48.292956 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-939e16ae-2ed6-4700-8f3c-aea71c53b902 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1523 microversion: 2.1 time: 0.163407 Sep 25 04:37:48.294252 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 130/315] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:48 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:48.893003 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-d05a54f2-401b-438d-82b8-9275b5e421b5 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:48.893611 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-d05a54f2-401b-438d-82b8-9275b5e421b5 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:48.899485 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d05a54f2-401b-438d-82b8-9275b5e421b5 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:48.899960 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d05a54f2-401b-438d-82b8-9275b5e421b5 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:48.900386 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d05a54f2-401b-438d-82b8-9275b5e421b5 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:48.901095 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d05a54f2-401b-438d-82b8-9275b5e421b5 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:48.901667 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d05a54f2-401b-438d-82b8-9275b5e421b5 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:48.902093 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d05a54f2-401b-438d-82b8-9275b5e421b5 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:48.933697 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d05a54f2-401b-438d-82b8-9275b5e421b5 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:48.934342 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d05a54f2-401b-438d-82b8-9275b5e421b5 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:48.934775 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d05a54f2-401b-438d-82b8-9275b5e421b5 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:48.935211 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.objects.instance [None req-d05a54f2-401b-438d-82b8-9275b5e421b5 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lazy-loading 'fault' on Instance uuid f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 {{(pid=127142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 04:37:48.982642 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-d05a54f2-401b-438d-82b8-9275b5e421b5 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1bf78eb0a94bab884b1df13c081096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5b6ce14ab47dfac99cc80153d7735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:48.991071 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-d05a54f2-401b-438d-82b8-9275b5e421b5 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 200 len: 1350 microversion: 2.1 time: 0.102151 Sep 25 04:37:48.991633 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 186/316] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:48 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 1350 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:49.317193 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-0ef6c851-6370-4fce-bd19-1843fd3a0b69 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:49.317802 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-0ef6c851-6370-4fce-bd19-1843fd3a0b69 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:49.324414 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0ef6c851-6370-4fce-bd19-1843fd3a0b69 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:49.325141 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0ef6c851-6370-4fce-bd19-1843fd3a0b69 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:49.325761 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0ef6c851-6370-4fce-bd19-1843fd3a0b69 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:49.338930 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0ef6c851-6370-4fce-bd19-1843fd3a0b69 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:49.339606 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0ef6c851-6370-4fce-bd19-1843fd3a0b69 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:49.340065 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0ef6c851-6370-4fce-bd19-1843fd3a0b69 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:49.478855 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-0ef6c851-6370-4fce-bd19-1843fd3a0b69 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:49.487339 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-0ef6c851-6370-4fce-bd19-1843fd3a0b69 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1503 microversion: 2.1 time: 0.174064 Sep 25 04:37:49.488068 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 131/317] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:49 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1503 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:49.509532 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-e74784ea-b9ec-4556-9f49-6c004f9f3770 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:49.510138 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-e74784ea-b9ec-4556-9f49-6c004f9f3770 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 8a4fe760-3afd-42e5-9909-86ca268c9b96] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:49.516474 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e74784ea-b9ec-4556-9f49-6c004f9f3770 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:49.517001 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e74784ea-b9ec-4556-9f49-6c004f9f3770 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:49.517438 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e74784ea-b9ec-4556-9f49-6c004f9f3770 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:49.518128 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e74784ea-b9ec-4556-9f49-6c004f9f3770 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:49.518580 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e74784ea-b9ec-4556-9f49-6c004f9f3770 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:49.519003 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e74784ea-b9ec-4556-9f49-6c004f9f3770 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:49.727553 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-e74784ea-b9ec-4556-9f49-6c004f9f3770 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:49.736060 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-e74784ea-b9ec-4556-9f49-6c004f9f3770 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96" status: 200 len: 1516 microversion: 2.1 time: 0.230287 Sep 25 04:37:49.736621 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 187/318] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:49 2022] GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96 => generated 1516 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:50.016021 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-bf3f6ca3-bc5d-4f07-836b-cba7893df80e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:50.016761 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-bf3f6ca3-bc5d-4f07-836b-cba7893df80e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:50.023332 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bf3f6ca3-bc5d-4f07-836b-cba7893df80e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:50.023895 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bf3f6ca3-bc5d-4f07-836b-cba7893df80e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:50.024584 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bf3f6ca3-bc5d-4f07-836b-cba7893df80e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:50.025397 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bf3f6ca3-bc5d-4f07-836b-cba7893df80e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:50.026237 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bf3f6ca3-bc5d-4f07-836b-cba7893df80e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:50.026938 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bf3f6ca3-bc5d-4f07-836b-cba7893df80e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:50.045776 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.wsgi [None req-bf3f6ca3-bc5d-4f07-836b-cba7893df80e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] HTTP exception thrown: Instance f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 could not be found. Sep 25 04:37:50.047053 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-bf3f6ca3-bc5d-4f07-836b-cba7893df80e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Request method failure captured: Sep 25 04:37:50.047053 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: request: GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 HTTP/1.1 Sep 25 04:37:50.047053 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept: application/json Sep 25 04:37:50.047053 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept-Encoding: identity Sep 25 04:37:50.047053 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Connection: close Sep 25 04:37:50.047053 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Length: 0 Sep 25 04:37:50.047053 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Type: application/json Sep 25 04:37:50.047053 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Host: 10.222.0.25 Sep 25 04:37:50.047053 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Openstack-System-Scope: None Sep 25 04:37:50.047053 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: User-Agent: python-urllib3/1.26.12 Sep 25 04:37:50.047053 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Auth-Token: gAAAAABjL9qpfrJ7n3DZeYu_0f_ge8NBJIUZt7F25rBoZsLTo4wjAlu4uNQZTh32ZntPVGdzNIR-TpsD-1k9chz1jYPPxc4fwnmLpfpwFP2EVY725DJllySeuCqNhY8iRJdeFr4ulw-RC1K_y0fbCvP_aAeS7uSm2uDpj7tHZCkvJodRQTRm1Ck Sep 25 04:37:50.047053 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Id: None Sep 25 04:37:50.047053 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Name: None Sep 25 04:37:50.047053 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Identity-Status: Confirmed Sep 25 04:37:50.047053 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Is-Admin-Project: True Sep 25 04:37:50.047053 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Id: default Sep 25 04:37:50.047053 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Name: Default Sep 25 04:37:50.047053 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Id: 80e5b6ce14ab47dfac99cc80153d7735 Sep 25 04:37:50.047053 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Name: tempest-DeleteServersTestJSON-1054641876 Sep 25 04:37:50.047053 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Role: reader,member Sep 25 04:37:50.047053 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Roles: reader,member Sep 25 04:37:50.048782 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/80e5b6ce14ab47dfac99cc80153d7735"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/80e5b6ce14ab47dfac99cc80153d7735"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/80e5b6ce14ab47dfac99cc80153d7735"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_80e5b6ce14ab47dfac99cc80153d7735"}]}] Sep 25 04:37:50.048782 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant: tempest-DeleteServersTestJSON-1054641876 Sep 25 04:37:50.048782 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Id: 80e5b6ce14ab47dfac99cc80153d7735 Sep 25 04:37:50.048782 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Name: tempest-DeleteServersTestJSON-1054641876 Sep 25 04:37:50.048782 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User: tempest-DeleteServersTestJSON-1054641876-project Sep 25 04:37:50.048782 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Id: default Sep 25 04:37:50.048782 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Name: Default Sep 25 04:37:50.048782 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Id: 1d1bf78eb0a94bab884b1df13c081096 Sep 25 04:37:50.048782 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Name: tempest-DeleteServersTestJSON-1054641876-project Sep 25 04:37:50.048782 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: method: > Sep 25 04:37:50.048782 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: exception: Instance f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 could not be found. Sep 25 04:37:50.048782 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: action_args: {'id': 'f4dfff9d-4fc4-4f36-aab0-786607ac2cd2'} Sep 25 04:37:50.049634 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:37:50.049634 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:37:50.049634 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:37:50.049634 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:37:50.049634 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:37:50.049634 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:37:50.049634 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:37:50.049634 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:37:50.049634 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:37:50.049634 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:37:50.049634 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 could not be found. Sep 25 04:37:50.049634 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:37:50.049634 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:37:50.049634 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:37:50.049634 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:37:50.049634 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:37:50.049634 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:37:50.049634 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:37:50.049634 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:37:50.049634 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:37:50.050965 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:37:50.050965 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 04:37:50.050965 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 04:37:50.050965 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:37:50.050965 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:37:50.050965 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:37:50.050965 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:37:50.050965 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 could not be found. Sep 25 04:37:50.050965 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:37:50.050965 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:37:50.050965 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:37:50.050965 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:37:50.050965 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:37:50.050965 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:37:50.050965 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:37:50.050965 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:37:50.050965 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 could not be found. Sep 25 04:37:50.050965 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:37:50.052187 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-bf3f6ca3-bc5d-4f07-836b-cba7893df80e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Returning 404 to user: Instance f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 could not be found. {{(pid=127141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:37:50.052187 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-bf3f6ca3-bc5d-4f07-836b-cba7893df80e tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 404 len: 111 microversion: 2.1 time: 0.038307 Sep 25 04:37:50.052187 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 132/319] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:50 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 04:37:50.214529 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-db7b2dcc-606e-43f3-8421-f8e796e391bf tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:50.217518 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-db7b2dcc-606e-43f3-8421-f8e796e391bf tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:50.224087 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-db7b2dcc-606e-43f3-8421-f8e796e391bf tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:50.224590 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-db7b2dcc-606e-43f3-8421-f8e796e391bf tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:50.225243 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-db7b2dcc-606e-43f3-8421-f8e796e391bf tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:50.225955 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-db7b2dcc-606e-43f3-8421-f8e796e391bf tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:50.226428 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-db7b2dcc-606e-43f3-8421-f8e796e391bf tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:50.228858 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-db7b2dcc-606e-43f3-8421-f8e796e391bf tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:50.244120 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.wsgi [None req-db7b2dcc-606e-43f3-8421-f8e796e391bf tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] HTTP exception thrown: Instance f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 could not be found. Sep 25 04:37:50.250264 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-db7b2dcc-606e-43f3-8421-f8e796e391bf tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Request method failure captured: Sep 25 04:37:50.250264 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: request: GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2/os-volume_attachments HTTP/1.1 Sep 25 04:37:50.250264 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept: application/json Sep 25 04:37:50.250264 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept-Encoding: identity Sep 25 04:37:50.250264 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Connection: close Sep 25 04:37:50.250264 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Length: 0 Sep 25 04:37:50.250264 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Type: application/json Sep 25 04:37:50.250264 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Host: 10.222.0.25 Sep 25 04:37:50.250264 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Openstack-System-Scope: None Sep 25 04:37:50.250264 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: User-Agent: python-urllib3/1.26.12 Sep 25 04:37:50.250264 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Auth-Token: gAAAAABjL9qpfrJ7n3DZeYu_0f_ge8NBJIUZt7F25rBoZsLTo4wjAlu4uNQZTh32ZntPVGdzNIR-TpsD-1k9chz1jYPPxc4fwnmLpfpwFP2EVY725DJllySeuCqNhY8iRJdeFr4ulw-RC1K_y0fbCvP_aAeS7uSm2uDpj7tHZCkvJodRQTRm1Ck Sep 25 04:37:50.250264 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Id: None Sep 25 04:37:50.250264 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Name: None Sep 25 04:37:50.250264 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Identity-Status: Confirmed Sep 25 04:37:50.250264 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Is-Admin-Project: True Sep 25 04:37:50.250264 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Id: default Sep 25 04:37:50.250264 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Name: Default Sep 25 04:37:50.250264 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Id: 80e5b6ce14ab47dfac99cc80153d7735 Sep 25 04:37:50.250264 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Name: tempest-DeleteServersTestJSON-1054641876 Sep 25 04:37:50.250264 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Role: reader,member Sep 25 04:37:50.250264 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Roles: reader,member Sep 25 04:37:50.251867 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/80e5b6ce14ab47dfac99cc80153d7735"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/80e5b6ce14ab47dfac99cc80153d7735"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/80e5b6ce14ab47dfac99cc80153d7735"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_80e5b6ce14ab47dfac99cc80153d7735"}]}] Sep 25 04:37:50.251867 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant: tempest-DeleteServersTestJSON-1054641876 Sep 25 04:37:50.251867 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Id: 80e5b6ce14ab47dfac99cc80153d7735 Sep 25 04:37:50.251867 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Name: tempest-DeleteServersTestJSON-1054641876 Sep 25 04:37:50.251867 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User: tempest-DeleteServersTestJSON-1054641876-project Sep 25 04:37:50.251867 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Id: default Sep 25 04:37:50.251867 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Name: Default Sep 25 04:37:50.251867 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Id: 1d1bf78eb0a94bab884b1df13c081096 Sep 25 04:37:50.251867 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Name: tempest-DeleteServersTestJSON-1054641876-project Sep 25 04:37:50.251867 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: method: > Sep 25 04:37:50.251867 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: exception: Instance f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 could not be found. Sep 25 04:37:50.251867 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: action_args: {'server_id': 'f4dfff9d-4fc4-4f36-aab0-786607ac2cd2'} Sep 25 04:37:50.252745 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:37:50.252745 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:37:50.252745 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:37:50.252745 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:37:50.252745 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:37:50.252745 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:37:50.252745 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:37:50.252745 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:37:50.252745 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:37:50.252745 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:37:50.252745 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 could not be found. Sep 25 04:37:50.252745 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:37:50.252745 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:37:50.252745 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:37:50.252745 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:37:50.252745 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:37:50.252745 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:37:50.252745 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:37:50.252745 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:37:50.252745 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:37:50.254119 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:37:50.254119 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 25 04:37:50.254119 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 04:37:50.254119 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 25 04:37:50.254119 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 04:37:50.254119 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 25 04:37:50.254119 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 25 04:37:50.254119 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:37:50.254119 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:37:50.254119 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 could not be found. Sep 25 04:37:50.254119 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:37:50.254119 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:37:50.254119 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:37:50.254119 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:37:50.254119 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:37:50.254119 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:37:50.254119 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:37:50.254119 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:37:50.254119 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 could not be found. Sep 25 04:37:50.254119 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:37:50.257241 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-db7b2dcc-606e-43f3-8421-f8e796e391bf tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Returning 404 to user: Instance f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 could not be found. {{(pid=127142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:37:50.258523 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-db7b2dcc-606e-43f3-8421-f8e796e391bf tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.048695 Sep 25 04:37:50.259363 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 188/320] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 25 04:37:50 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2/os-volume_attachments => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 04:37:52.332472 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-9fbefea8-b8f2-4238-ac94-2206950d71dd tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:37:52.335366 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-9fbefea8-b8f2-4238-ac94-2206950d71dd tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 8a4fe760-3afd-42e5-9909-86ca268c9b96] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:52.344018 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9fbefea8-b8f2-4238-ac94-2206950d71dd tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:52.344659 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9fbefea8-b8f2-4238-ac94-2206950d71dd tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:52.345151 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9fbefea8-b8f2-4238-ac94-2206950d71dd tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:52.345879 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9fbefea8-b8f2-4238-ac94-2206950d71dd tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:52.348366 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9fbefea8-b8f2-4238-ac94-2206950d71dd tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:52.348911 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9fbefea8-b8f2-4238-ac94-2206950d71dd tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:52.373527 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.objects.instance [None req-9fbefea8-b8f2-4238-ac94-2206950d71dd tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lazy-loading 'flavor' on Instance uuid 8a4fe760-3afd-42e5-9909-86ca268c9b96 {{(pid=127141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 04:37:52.493951 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-9fbefea8-b8f2-4238-ac94-2206950d71dd tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "POST /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96/action" status: 200 len: 32 microversion: 2.1 time: 0.165843 Sep 25 04:37:52.494543 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 133/321] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 25 04:37:52 2022] POST /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96/action => generated 32 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 04:37:52.504412 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-eb95ec3c-a9f7-42af-85a1-c5990e4569b5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:52.505044 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-eb95ec3c-a9f7-42af-85a1-c5990e4569b5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 8a4fe760-3afd-42e5-9909-86ca268c9b96] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:52.513481 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-eb95ec3c-a9f7-42af-85a1-c5990e4569b5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:52.514037 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-eb95ec3c-a9f7-42af-85a1-c5990e4569b5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:52.514666 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-eb95ec3c-a9f7-42af-85a1-c5990e4569b5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:52.515335 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-eb95ec3c-a9f7-42af-85a1-c5990e4569b5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:52.516044 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-eb95ec3c-a9f7-42af-85a1-c5990e4569b5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:52.517300 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-eb95ec3c-a9f7-42af-85a1-c5990e4569b5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:52.602989 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-99ba1194-8955-4eca-8494-cfabd820da9a tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:52.604373 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-99ba1194-8955-4eca-8494-cfabd820da9a tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:52.612995 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-99ba1194-8955-4eca-8494-cfabd820da9a tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:52.613568 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-99ba1194-8955-4eca-8494-cfabd820da9a tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:52.614376 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-99ba1194-8955-4eca-8494-cfabd820da9a tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:52.615171 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-99ba1194-8955-4eca-8494-cfabd820da9a tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:52.615833 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-99ba1194-8955-4eca-8494-cfabd820da9a tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:52.616436 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-99ba1194-8955-4eca-8494-cfabd820da9a tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:52.630287 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.wsgi [None req-99ba1194-8955-4eca-8494-cfabd820da9a tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] HTTP exception thrown: Instance f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 could not be found. Sep 25 04:37:52.632133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-99ba1194-8955-4eca-8494-cfabd820da9a tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Request method failure captured: Sep 25 04:37:52.632133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: request: DELETE /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 HTTP/1.1 Sep 25 04:37:52.632133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept: application/json Sep 25 04:37:52.632133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept-Encoding: identity Sep 25 04:37:52.632133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Connection: close Sep 25 04:37:52.632133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Length: 0 Sep 25 04:37:52.632133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Type: application/json Sep 25 04:37:52.632133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Host: 10.222.0.25 Sep 25 04:37:52.632133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Openstack-System-Scope: None Sep 25 04:37:52.632133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: User-Agent: python-urllib3/1.26.12 Sep 25 04:37:52.632133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Auth-Token: gAAAAABjL9qpfrJ7n3DZeYu_0f_ge8NBJIUZt7F25rBoZsLTo4wjAlu4uNQZTh32ZntPVGdzNIR-TpsD-1k9chz1jYPPxc4fwnmLpfpwFP2EVY725DJllySeuCqNhY8iRJdeFr4ulw-RC1K_y0fbCvP_aAeS7uSm2uDpj7tHZCkvJodRQTRm1Ck Sep 25 04:37:52.632133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Id: None Sep 25 04:37:52.632133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Name: None Sep 25 04:37:52.632133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Identity-Status: Confirmed Sep 25 04:37:52.632133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Is-Admin-Project: True Sep 25 04:37:52.632133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Id: default Sep 25 04:37:52.632133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Name: Default Sep 25 04:37:52.632133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Id: 80e5b6ce14ab47dfac99cc80153d7735 Sep 25 04:37:52.632133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Name: tempest-DeleteServersTestJSON-1054641876 Sep 25 04:37:52.632133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Role: reader,member Sep 25 04:37:52.632133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Roles: reader,member Sep 25 04:37:52.633772 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/80e5b6ce14ab47dfac99cc80153d7735"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/80e5b6ce14ab47dfac99cc80153d7735"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/80e5b6ce14ab47dfac99cc80153d7735"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_80e5b6ce14ab47dfac99cc80153d7735"}]}] Sep 25 04:37:52.633772 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant: tempest-DeleteServersTestJSON-1054641876 Sep 25 04:37:52.633772 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Id: 80e5b6ce14ab47dfac99cc80153d7735 Sep 25 04:37:52.633772 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Name: tempest-DeleteServersTestJSON-1054641876 Sep 25 04:37:52.633772 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User: tempest-DeleteServersTestJSON-1054641876-project Sep 25 04:37:52.633772 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Id: default Sep 25 04:37:52.633772 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Name: Default Sep 25 04:37:52.633772 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Id: 1d1bf78eb0a94bab884b1df13c081096 Sep 25 04:37:52.633772 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Name: tempest-DeleteServersTestJSON-1054641876-project Sep 25 04:37:52.633772 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: method: > Sep 25 04:37:52.633772 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: exception: Instance f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 could not be found. Sep 25 04:37:52.633772 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: action_args: {'id': 'f4dfff9d-4fc4-4f36-aab0-786607ac2cd2'} Sep 25 04:37:52.634611 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:37:52.634611 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:37:52.634611 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:37:52.634611 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:37:52.634611 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:37:52.634611 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:37:52.634611 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:37:52.634611 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:37:52.634611 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:37:52.634611 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:37:52.634611 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 could not be found. Sep 25 04:37:52.634611 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:37:52.634611 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:37:52.634611 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:37:52.634611 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:37:52.634611 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:37:52.634611 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:37:52.634611 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:37:52.634611 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:37:52.634611 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:37:52.636704 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:37:52.636704 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 04:37:52.636704 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 04:37:52.636704 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 04:37:52.636704 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 04:37:52.636704 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:37:52.636704 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:37:52.636704 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:37:52.636704 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:37:52.636704 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 could not be found. Sep 25 04:37:52.636704 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:37:52.636704 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:37:52.636704 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:37:52.636704 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:37:52.636704 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:37:52.636704 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:37:52.636704 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:37:52.636704 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:37:52.636704 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 could not be found. Sep 25 04:37:52.636704 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:37:52.638422 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-99ba1194-8955-4eca-8494-cfabd820da9a tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Returning 404 to user: Instance f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 could not be found. {{(pid=127141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:37:52.638422 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-99ba1194-8955-4eca-8494-cfabd820da9a tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 404 len: 111 microversion: 2.1 time: 0.036372 Sep 25 04:37:52.638422 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 134/322] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 25 04:37:52 2022] DELETE /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 04:37:52.646662 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-59d08fc7-ab2e-4041-badf-8bc4d5db48e0 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:52.647265 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-59d08fc7-ab2e-4041-badf-8bc4d5db48e0 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] [instance: f4dfff9d-4fc4-4f36-aab0-786607ac2cd2] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:52.653476 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-59d08fc7-ab2e-4041-badf-8bc4d5db48e0 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:52.653987 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-59d08fc7-ab2e-4041-badf-8bc4d5db48e0 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:52.654418 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-59d08fc7-ab2e-4041-badf-8bc4d5db48e0 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:52.655103 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-59d08fc7-ab2e-4041-badf-8bc4d5db48e0 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:52.655561 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-59d08fc7-ab2e-4041-badf-8bc4d5db48e0 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:52.655972 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-59d08fc7-ab2e-4041-badf-8bc4d5db48e0 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:52.671452 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.wsgi [None req-59d08fc7-ab2e-4041-badf-8bc4d5db48e0 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] HTTP exception thrown: Instance f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 could not be found. Sep 25 04:37:52.673132 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-59d08fc7-ab2e-4041-badf-8bc4d5db48e0 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Request method failure captured: Sep 25 04:37:52.673132 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: request: GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 HTTP/1.1 Sep 25 04:37:52.673132 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept: application/json Sep 25 04:37:52.673132 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept-Encoding: identity Sep 25 04:37:52.673132 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Connection: close Sep 25 04:37:52.673132 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Length: 0 Sep 25 04:37:52.673132 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Type: application/json Sep 25 04:37:52.673132 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Host: 10.222.0.25 Sep 25 04:37:52.673132 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Openstack-System-Scope: None Sep 25 04:37:52.673132 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: User-Agent: python-urllib3/1.26.12 Sep 25 04:37:52.673132 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Auth-Token: gAAAAABjL9qpfrJ7n3DZeYu_0f_ge8NBJIUZt7F25rBoZsLTo4wjAlu4uNQZTh32ZntPVGdzNIR-TpsD-1k9chz1jYPPxc4fwnmLpfpwFP2EVY725DJllySeuCqNhY8iRJdeFr4ulw-RC1K_y0fbCvP_aAeS7uSm2uDpj7tHZCkvJodRQTRm1Ck Sep 25 04:37:52.673132 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Id: None Sep 25 04:37:52.673132 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Name: None Sep 25 04:37:52.673132 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Identity-Status: Confirmed Sep 25 04:37:52.673132 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Is-Admin-Project: True Sep 25 04:37:52.673132 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Id: default Sep 25 04:37:52.673132 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Name: Default Sep 25 04:37:52.673132 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Id: 80e5b6ce14ab47dfac99cc80153d7735 Sep 25 04:37:52.673132 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Name: tempest-DeleteServersTestJSON-1054641876 Sep 25 04:37:52.673132 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Role: reader,member Sep 25 04:37:52.673132 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Roles: reader,member Sep 25 04:37:52.674585 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/80e5b6ce14ab47dfac99cc80153d7735"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/80e5b6ce14ab47dfac99cc80153d7735"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/80e5b6ce14ab47dfac99cc80153d7735"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_80e5b6ce14ab47dfac99cc80153d7735"}]}] Sep 25 04:37:52.674585 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant: tempest-DeleteServersTestJSON-1054641876 Sep 25 04:37:52.674585 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Id: 80e5b6ce14ab47dfac99cc80153d7735 Sep 25 04:37:52.674585 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Name: tempest-DeleteServersTestJSON-1054641876 Sep 25 04:37:52.674585 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User: tempest-DeleteServersTestJSON-1054641876-project Sep 25 04:37:52.674585 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Id: default Sep 25 04:37:52.674585 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Name: Default Sep 25 04:37:52.674585 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Id: 1d1bf78eb0a94bab884b1df13c081096 Sep 25 04:37:52.674585 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Name: tempest-DeleteServersTestJSON-1054641876-project Sep 25 04:37:52.674585 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: method: > Sep 25 04:37:52.674585 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: exception: Instance f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 could not be found. Sep 25 04:37:52.674585 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: action_args: {'id': 'f4dfff9d-4fc4-4f36-aab0-786607ac2cd2'} Sep 25 04:37:52.675384 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:37:52.675384 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:37:52.675384 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:37:52.675384 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:37:52.675384 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:37:52.675384 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:37:52.675384 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:37:52.675384 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:37:52.675384 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:37:52.675384 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:37:52.675384 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 could not be found. Sep 25 04:37:52.675384 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:37:52.675384 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:37:52.675384 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:37:52.675384 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:37:52.675384 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:37:52.675384 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:37:52.675384 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:37:52.675384 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:37:52.675384 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:37:52.676916 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:37:52.676916 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 04:37:52.676916 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 04:37:52.676916 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:37:52.676916 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:37:52.676916 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:37:52.676916 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:37:52.676916 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 could not be found. Sep 25 04:37:52.676916 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:37:52.676916 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:37:52.676916 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:37:52.676916 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:37:52.676916 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:37:52.676916 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:37:52.676916 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:37:52.676916 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:37:52.676916 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 could not be found. Sep 25 04:37:52.676916 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:37:52.678198 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-59d08fc7-ab2e-4041-badf-8bc4d5db48e0 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] Returning 404 to user: Instance f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 could not be found. {{(pid=127141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:37:52.678198 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-59d08fc7-ab2e-4041-badf-8bc4d5db48e0 tempest-DeleteServersTestJSON-1054641876 tempest-DeleteServersTestJSON-1054641876-project] 10.222.0.25 "GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2" status: 404 len: 111 microversion: 2.1 time: 0.032805 Sep 25 04:37:52.678198 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 135/323] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:52 2022] GET /compute/v2.1/servers/f4dfff9d-4fc4-4f36-aab0-786607ac2cd2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 04:37:52.952978 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-eb95ec3c-a9f7-42af-85a1-c5990e4569b5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:52.963661 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-eb95ec3c-a9f7-42af-85a1-c5990e4569b5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96" status: 200 len: 1522 microversion: 2.1 time: 0.463040 Sep 25 04:37:52.964822 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 189/324] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:52 2022] GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96 => generated 1522 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:53.987170 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-ec8ab7b6-7e46-4093-b797-1e92a6a1a37a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:53.988414 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-ec8ab7b6-7e46-4093-b797-1e92a6a1a37a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 8a4fe760-3afd-42e5-9909-86ca268c9b96] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:53.995624 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ec8ab7b6-7e46-4093-b797-1e92a6a1a37a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:54.001659 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ec8ab7b6-7e46-4093-b797-1e92a6a1a37a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:54.002305 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ec8ab7b6-7e46-4093-b797-1e92a6a1a37a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:54.003237 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ec8ab7b6-7e46-4093-b797-1e92a6a1a37a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:54.003707 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ec8ab7b6-7e46-4093-b797-1e92a6a1a37a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:54.004137 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ec8ab7b6-7e46-4093-b797-1e92a6a1a37a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:54.156406 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-ec8ab7b6-7e46-4093-b797-1e92a6a1a37a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:54.170770 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-ec8ab7b6-7e46-4093-b797-1e92a6a1a37a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96" status: 200 len: 1522 microversion: 2.1 time: 0.187291 Sep 25 04:37:54.184478 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 136/325] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:53 2022] GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:55.195797 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-90893580-e428-4cb1-ba37-5a8a981433a9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:55.196438 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-90893580-e428-4cb1-ba37-5a8a981433a9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 8a4fe760-3afd-42e5-9909-86ca268c9b96] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:55.203597 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-90893580-e428-4cb1-ba37-5a8a981433a9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:55.203923 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-90893580-e428-4cb1-ba37-5a8a981433a9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:55.204459 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-90893580-e428-4cb1-ba37-5a8a981433a9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:55.205275 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-90893580-e428-4cb1-ba37-5a8a981433a9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:55.205795 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-90893580-e428-4cb1-ba37-5a8a981433a9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:55.206398 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-90893580-e428-4cb1-ba37-5a8a981433a9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:55.349017 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-90893580-e428-4cb1-ba37-5a8a981433a9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:55.358491 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-90893580-e428-4cb1-ba37-5a8a981433a9 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96" status: 200 len: 1522 microversion: 2.1 time: 0.166590 Sep 25 04:37:55.373427 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 190/326] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:55 2022] GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:56.383450 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-0d743078-0d9c-40fd-a03f-c3d24a018213 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:56.384078 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-0d743078-0d9c-40fd-a03f-c3d24a018213 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 8a4fe760-3afd-42e5-9909-86ca268c9b96] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:56.391535 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0d743078-0d9c-40fd-a03f-c3d24a018213 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:56.392025 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0d743078-0d9c-40fd-a03f-c3d24a018213 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:56.392483 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0d743078-0d9c-40fd-a03f-c3d24a018213 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:56.393293 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0d743078-0d9c-40fd-a03f-c3d24a018213 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:56.393753 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0d743078-0d9c-40fd-a03f-c3d24a018213 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:56.394179 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0d743078-0d9c-40fd-a03f-c3d24a018213 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:56.591727 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-0d743078-0d9c-40fd-a03f-c3d24a018213 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:56.599724 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-0d743078-0d9c-40fd-a03f-c3d24a018213 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96" status: 200 len: 1522 microversion: 2.1 time: 0.220041 Sep 25 04:37:56.600229 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 137/327] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:56 2022] GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:57.622350 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-bcaaeae8-becd-4800-ade4-90083615e195 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:57.623177 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-bcaaeae8-becd-4800-ade4-90083615e195 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 8a4fe760-3afd-42e5-9909-86ca268c9b96] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:57.629957 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bcaaeae8-becd-4800-ade4-90083615e195 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:57.630570 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bcaaeae8-becd-4800-ade4-90083615e195 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:57.631144 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bcaaeae8-becd-4800-ade4-90083615e195 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:57.631963 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bcaaeae8-becd-4800-ade4-90083615e195 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:57.632698 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bcaaeae8-becd-4800-ade4-90083615e195 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:57.633544 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bcaaeae8-becd-4800-ade4-90083615e195 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:57.773421 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-bcaaeae8-becd-4800-ade4-90083615e195 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:57.781792 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-bcaaeae8-becd-4800-ade4-90083615e195 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96" status: 200 len: 1522 microversion: 2.1 time: 0.164112 Sep 25 04:37:57.782448 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 191/328] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:57 2022] GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:37:58.805400 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-a02cff85-31d0-4d23-9b78-4e23cd001ce3 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:58.806053 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-a02cff85-31d0-4d23-9b78-4e23cd001ce3 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 8a4fe760-3afd-42e5-9909-86ca268c9b96] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:58.808402 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_api:SELECT=58 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:58.814513 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a02cff85-31d0-4d23-9b78-4e23cd001ce3 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:58.815008 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a02cff85-31d0-4d23-9b78-4e23cd001ce3 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:58.815450 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a02cff85-31d0-4d23-9b78-4e23cd001ce3 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:58.816160 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a02cff85-31d0-4d23-9b78-4e23cd001ce3 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:58.816617 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a02cff85-31d0-4d23-9b78-4e23cd001ce3 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:58.817072 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a02cff85-31d0-4d23-9b78-4e23cd001ce3 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:58.823027 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:37:58.950763 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-a02cff85-31d0-4d23-9b78-4e23cd001ce3 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:37:58.959060 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-a02cff85-31d0-4d23-9b78-4e23cd001ce3 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96" status: 200 len: 1522 microversion: 2.1 time: 0.157727 Sep 25 04:37:58.959618 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 138/329] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:58 2022] GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:37:59.982374 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-5850b272-4d0f-42bf-ae81-563f86e1b520 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:37:59.982984 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-5850b272-4d0f-42bf-ae81-563f86e1b520 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 8a4fe760-3afd-42e5-9909-86ca268c9b96] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:37:59.989315 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5850b272-4d0f-42bf-ae81-563f86e1b520 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:59.989803 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5850b272-4d0f-42bf-ae81-563f86e1b520 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:59.990244 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5850b272-4d0f-42bf-ae81-563f86e1b520 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:37:59.990929 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5850b272-4d0f-42bf-ae81-563f86e1b520 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:37:59.991388 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5850b272-4d0f-42bf-ae81-563f86e1b520 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:37:59.991814 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5850b272-4d0f-42bf-ae81-563f86e1b520 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:00.129995 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-5850b272-4d0f-42bf-ae81-563f86e1b520 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:00.141380 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-5850b272-4d0f-42bf-ae81-563f86e1b520 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96" status: 200 len: 1522 microversion: 2.1 time: 0.163000 Sep 25 04:38:00.142834 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 192/330] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:37:59 2022] GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:00.163034 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-9458fd44-7d2f-4e50-a530-fa678918115f tempest-VolumesTestJSON-2103695149 tempest-VolumesTestJSON-2103695149-project] Calling method '.version_select at 0x7f4d3ef25700>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:00.218489 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-9458fd44-7d2f-4e50-a530-fa678918115f tempest-VolumesTestJSON-2103695149 tempest-VolumesTestJSON-2103695149-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/c1f6578a-ef90-48ac-b170-31705ef60e48" status: 200 len: 351 microversion: 2.1 time: 0.058729 Sep 25 04:38:00.220127 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 139/331] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Sep 25 04:38:00 2022] GET /compute/v2.1/os-volumes/c1f6578a-ef90-48ac-b170-31705ef60e48 => generated 351 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:38:00.237329 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-127ff612-0da6-459a-8b7f-e9ac0cc3c36b tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-622545764", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-363590622", "security_groups": [{"name": "tempest-secgroup-smoke-2021890742"}], "block_device_mapping_v2": [{"uuid": "20cb2454-9baf-43cb-929e-c8123bf94ff6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fc0edd4f-78eb-4338-9c41-437457efbef1"}]}} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:38:00.248468 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:38:00.384515 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.network.neutron [None req-127ff612-0da6-459a-8b7f-e9ac0cc3c36b tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] validate_networks() for [('fc0edd4f-78eb-4338-9c41-437457efbef1', None, None, None, None, None)] {{(pid=127142) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 04:38:00.793387 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-127ff612-0da6-459a-8b7f-e9ac0cc3c36b tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Flavor limits 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 04:38:00.793805 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-127ff612-0da6-459a-8b7f-e9ac0cc3c36b tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Image limits 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 04:38:00.794328 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-127ff612-0da6-459a-8b7f-e9ac0cc3c36b tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Flavor pref 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 04:38:00.794732 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-127ff612-0da6-459a-8b7f-e9ac0cc3c36b tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Image pref 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 04:38:00.795137 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-127ff612-0da6-459a-8b7f-e9ac0cc3c36b tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 04:38:00.803766 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-127ff612-0da6-459a-8b7f-e9ac0cc3c36b tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:00.804238 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-127ff612-0da6-459a-8b7f-e9ac0cc3c36b tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:00.804693 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-127ff612-0da6-459a-8b7f-e9ac0cc3c36b tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:00.805408 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-127ff612-0da6-459a-8b7f-e9ac0cc3c36b tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:00.805858 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-127ff612-0da6-459a-8b7f-e9ac0cc3c36b tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:00.806277 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-127ff612-0da6-459a-8b7f-e9ac0cc3c36b tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:00.822954 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.quota [None req-127ff612-0da6-459a-8b7f-e9ac0cc3c36b tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Getting quotas for project 00f66d2c942b419abc8d9d010c5a57f3. Resources: {'instances', 'ram', 'cores'} {{(pid=127142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 04:38:00.827013 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.quota [None req-127ff612-0da6-459a-8b7f-e9ac0cc3c36b tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Getting quotas for user 329e3f9810b648218dd45a8b489adb1d and project 00f66d2c942b419abc8d9d010c5a57f3. Resources: {'instances', 'ram', 'cores'} {{(pid=127142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 04:38:00.883327 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-127ff612-0da6-459a-8b7f-e9ac0cc3c36b tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Going to run 1 instances... {{(pid=127142) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 04:38:00.885966 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-127ff612-0da6-459a-8b7f-e9ac0cc3c36b tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: d6138f3e-a927-4d61-890c-ccd60213e4f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='20cb2454-9baf-43cb-929e-c8123bf94ff6',volume_size=None,volume_type=None)] {{(pid=127142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 04:38:01.020091 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-127ff612-0da6-459a-8b7f-e9ac0cc3c36b tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.786637 Sep 25 04:38:01.021022 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 193/332] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 25 04:38:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 04:38:01.032656 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-74af6f5f-02c8-44d6-a3ae-7fa53dc69ba7 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:01.033278 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-74af6f5f-02c8-44d6-a3ae-7fa53dc69ba7 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: d6138f3e-a927-4d61-890c-ccd60213e4f2] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:01.095190 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-74af6f5f-02c8-44d6-a3ae-7fa53dc69ba7 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:01.102635 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-74af6f5f-02c8-44d6-a3ae-7fa53dc69ba7 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2" status: 200 len: 1093 microversion: 2.1 time: 0.073858 Sep 25 04:38:01.103183 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 140/333] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:01 2022] GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2 => generated 1093 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:01.171317 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-6fde3a27-d3b2-4541-b061-5690b3a41b19 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:01.171927 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-6fde3a27-d3b2-4541-b061-5690b3a41b19 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 8a4fe760-3afd-42e5-9909-86ca268c9b96] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:01.178390 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6fde3a27-d3b2-4541-b061-5690b3a41b19 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:01.178957 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6fde3a27-d3b2-4541-b061-5690b3a41b19 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:01.179603 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6fde3a27-d3b2-4541-b061-5690b3a41b19 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:01.180364 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6fde3a27-d3b2-4541-b061-5690b3a41b19 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:01.180921 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6fde3a27-d3b2-4541-b061-5690b3a41b19 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:01.181450 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6fde3a27-d3b2-4541-b061-5690b3a41b19 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:01.321234 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-6fde3a27-d3b2-4541-b061-5690b3a41b19 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:01.331824 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-6fde3a27-d3b2-4541-b061-5690b3a41b19 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96" status: 200 len: 1522 microversion: 2.1 time: 0.164482 Sep 25 04:38:01.332583 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 194/334] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:01 2022] GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:01.636967 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-c15a04a1-a4c9-4d06-a06e-7d4afdff9778 tempest-VolumesTestJSON-2103695149 tempest-VolumesTestJSON-2103695149-project] Calling method '.version_select at 0x7f4d3f1bd790>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:01.686995 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-c15a04a1-a4c9-4d06-a06e-7d4afdff9778 tempest-VolumesTestJSON-2103695149 tempest-VolumesTestJSON-2103695149-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/bb4ce8f0-742e-4aa5-b713-a3f805789848" status: 200 len: 351 microversion: 2.1 time: 0.054255 Sep 25 04:38:01.687568 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 141/335] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Sep 25 04:38:01 2022] GET /compute/v2.1/os-volumes/bb4ce8f0-742e-4aa5-b713-a3f805789848 => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:38:02.125564 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-b079dbaa-9ac2-448f-8471-98449ec2fc7f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:02.126084 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-b079dbaa-9ac2-448f-8471-98449ec2fc7f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: d6138f3e-a927-4d61-890c-ccd60213e4f2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:02.132345 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b079dbaa-9ac2-448f-8471-98449ec2fc7f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:02.132936 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b079dbaa-9ac2-448f-8471-98449ec2fc7f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:02.133382 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b079dbaa-9ac2-448f-8471-98449ec2fc7f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:02.134105 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b079dbaa-9ac2-448f-8471-98449ec2fc7f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:02.134564 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b079dbaa-9ac2-448f-8471-98449ec2fc7f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:02.135011 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b079dbaa-9ac2-448f-8471-98449ec2fc7f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:02.139141 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=100 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:38:02.197530 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-b079dbaa-9ac2-448f-8471-98449ec2fc7f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:02.205220 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-b079dbaa-9ac2-448f-8471-98449ec2fc7f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2" status: 200 len: 1191 microversion: 2.1 time: 0.083656 Sep 25 04:38:02.205777 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 195/336] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:02 2022] GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2 => generated 1191 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:02.355613 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-e7d669db-5c07-4d7d-82e6-a980c4dce139 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:02.356251 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-e7d669db-5c07-4d7d-82e6-a980c4dce139 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 8a4fe760-3afd-42e5-9909-86ca268c9b96] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:02.362122 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e7d669db-5c07-4d7d-82e6-a980c4dce139 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:02.362608 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e7d669db-5c07-4d7d-82e6-a980c4dce139 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:02.363045 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e7d669db-5c07-4d7d-82e6-a980c4dce139 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:02.363736 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e7d669db-5c07-4d7d-82e6-a980c4dce139 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:02.364224 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e7d669db-5c07-4d7d-82e6-a980c4dce139 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:02.364672 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e7d669db-5c07-4d7d-82e6-a980c4dce139 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:02.560119 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-e7d669db-5c07-4d7d-82e6-a980c4dce139 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:02.568917 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-e7d669db-5c07-4d7d-82e6-a980c4dce139 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96" status: 200 len: 1522 microversion: 2.1 time: 0.217456 Sep 25 04:38:02.569493 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 142/337] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:02 2022] GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:03.230415 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-ab96401c-eccc-464a-bc66-b975d28dc226 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:03.231604 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-ab96401c-eccc-464a-bc66-b975d28dc226 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: d6138f3e-a927-4d61-890c-ccd60213e4f2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:03.238943 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ab96401c-eccc-464a-bc66-b975d28dc226 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:03.239642 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ab96401c-eccc-464a-bc66-b975d28dc226 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:03.240082 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ab96401c-eccc-464a-bc66-b975d28dc226 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:03.240820 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ab96401c-eccc-464a-bc66-b975d28dc226 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:03.241482 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ab96401c-eccc-464a-bc66-b975d28dc226 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:03.241902 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ab96401c-eccc-464a-bc66-b975d28dc226 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:03.437243 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-ab96401c-eccc-464a-bc66-b975d28dc226 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:03.444923 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-ab96401c-eccc-464a-bc66-b975d28dc226 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2" status: 200 len: 1277 microversion: 2.1 time: 0.219446 Sep 25 04:38:03.445488 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 196/338] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:03 2022] GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2 => generated 1277 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:03.596681 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-6a807b09-e2b7-44c2-be3a-0dccdc542fb0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:03.598024 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-6a807b09-e2b7-44c2-be3a-0dccdc542fb0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 8a4fe760-3afd-42e5-9909-86ca268c9b96] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:03.603843 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6a807b09-e2b7-44c2-be3a-0dccdc542fb0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:03.604334 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6a807b09-e2b7-44c2-be3a-0dccdc542fb0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:03.604781 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6a807b09-e2b7-44c2-be3a-0dccdc542fb0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:03.605588 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6a807b09-e2b7-44c2-be3a-0dccdc542fb0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:03.606050 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6a807b09-e2b7-44c2-be3a-0dccdc542fb0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:03.607051 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6a807b09-e2b7-44c2-be3a-0dccdc542fb0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:03.812236 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-6a807b09-e2b7-44c2-be3a-0dccdc542fb0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:03.824775 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-6a807b09-e2b7-44c2-be3a-0dccdc542fb0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96" status: 200 len: 1522 microversion: 2.1 time: 0.232437 Sep 25 04:38:03.825379 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 143/339] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:03 2022] GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:04.114737 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-995e0327-395a-4a5f-85cb-93abbeb80851 req-07f5534e-9fb4-445f-ba3d-ad675ae035a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6138f3e-a927-4d61-890c-ccd60213e4f2", "tag": "9bd5cc76-3974-4656-ab0e-c104227f5d9c"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:38:04.129050 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-2f3390a6-d9f7-4fcd-91d0-a46e7515fbf3 tempest-VolumesTestJSON-2103695149 tempest-VolumesTestJSON-2103695149-project] Calling method '.version_select at 0x7f4d3eed3820>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:04.138968 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-995e0327-395a-4a5f-85cb-93abbeb80851 req-07f5534e-9fb4-445f-ba3d-ad675ae035a3 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:04.139610 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-995e0327-395a-4a5f-85cb-93abbeb80851 req-07f5534e-9fb4-445f-ba3d-ad675ae035a3 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:04.140043 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-995e0327-395a-4a5f-85cb-93abbeb80851 req-07f5534e-9fb4-445f-ba3d-ad675ae035a3 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:04.152733 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-995e0327-395a-4a5f-85cb-93abbeb80851 req-07f5534e-9fb4-445f-ba3d-ad675ae035a3 service nova] Creating event network-changed:9bd5cc76-3974-4656-ab0e-c104227f5d9c for instance d6138f3e-a927-4d61-890c-ccd60213e4f2 on hv-cinder-85535 Sep 25 04:38:04.159072 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-995e0327-395a-4a5f-85cb-93abbeb80851 req-07f5534e-9fb4-445f-ba3d-ad675ae035a3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046692 Sep 25 04:38:04.159859 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 197/340] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:38:04.195206 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-2f3390a6-d9f7-4fcd-91d0-a46e7515fbf3 tempest-VolumesTestJSON-2103695149 tempest-VolumesTestJSON-2103695149-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/0fa6b604-064e-4689-b7e0-f90fb98c63da" status: 200 len: 350 microversion: 2.1 time: 0.070912 Sep 25 04:38:04.197331 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 144/341] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Sep 25 04:38:04 2022] GET /compute/v2.1/os-volumes/0fa6b604-064e-4689-b7e0-f90fb98c63da => generated 350 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 04:38:04.211540 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-76b2ba49-aed6-4a48-873a-d08092467db1 tempest-VolumesTestJSON-2103695149 tempest-VolumesTestJSON-2103695149-project] Calling method '.version_select at 0x7f4d3ef731f0>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:04.295909 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-76b2ba49-aed6-4a48-873a-d08092467db1 tempest-VolumesTestJSON-2103695149 tempest-VolumesTestJSON-2103695149-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.088665 Sep 25 04:38:04.296486 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 198/342] 10.222.0.25 () {58 vars in 1134 bytes} [Sun Sep 25 04:38:04 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:04.311938 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-ca4caa22-5b18-44df-9fa2-bdb1bb5fc92d tempest-VolumesTestJSON-2103695149 tempest-VolumesTestJSON-2103695149-project] Calling method '.version_select at 0x7f4d3f05bdc0>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:04.394379 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-ca4caa22-5b18-44df-9fa2-bdb1bb5fc92d tempest-VolumesTestJSON-2103695149 tempest-VolumesTestJSON-2103695149-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.087370 Sep 25 04:38:04.394981 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 145/343] 10.222.0.25 () {58 vars in 1149 bytes} [Sun Sep 25 04:38:04 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:38:04.409185 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-d9ae4041-3fd2-4c45-88ed-b334049f8c90 tempest-VolumesTestJSON-2103695149 tempest-VolumesTestJSON-2103695149-project] Calling method '.version_select at 0x7f4d3ef83160>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:04.474737 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-7b4193db-1020-4f41-9a75-cca80c386b2f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:04.475352 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-7b4193db-1020-4f41-9a75-cca80c386b2f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: d6138f3e-a927-4d61-890c-ccd60213e4f2] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:04.485424 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7b4193db-1020-4f41-9a75-cca80c386b2f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:04.486205 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7b4193db-1020-4f41-9a75-cca80c386b2f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:04.486901 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7b4193db-1020-4f41-9a75-cca80c386b2f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:04.487698 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7b4193db-1020-4f41-9a75-cca80c386b2f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:04.488182 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7b4193db-1020-4f41-9a75-cca80c386b2f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:04.488685 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7b4193db-1020-4f41-9a75-cca80c386b2f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:04.497811 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-d9ae4041-3fd2-4c45-88ed-b334049f8c90 tempest-VolumesTestJSON-2103695149 tempest-VolumesTestJSON-2103695149-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.091159 Sep 25 04:38:04.497811 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 199/344] 10.222.0.25 () {58 vars in 1134 bytes} [Sun Sep 25 04:38:04 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:38:04.514348 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-89001857-2b68-4985-bbfc-6408acee46a7 tempest-VolumesTestJSON-2103695149 tempest-VolumesTestJSON-2103695149-project] Calling method '.version_select at 0x7f4d3ef7f550>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:04.599258 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-89001857-2b68-4985-bbfc-6408acee46a7 tempest-VolumesTestJSON-2103695149 tempest-VolumesTestJSON-2103695149-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.089166 Sep 25 04:38:04.600166 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 200/345] 10.222.0.25 () {58 vars in 1167 bytes} [Sun Sep 25 04:38:04 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:38:04.613719 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-9c9e7177-7539-4e5b-8920-333a357bc656 tempest-VolumesTestJSON-2103695149 tempest-VolumesTestJSON-2103695149-project] Calling method '.version_select at 0x7f4d3ef73ee0>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:04.629941 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-7b4193db-1020-4f41-9a75-cca80c386b2f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:04.647639 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-7b4193db-1020-4f41-9a75-cca80c386b2f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2" status: 200 len: 1265 microversion: 2.1 time: 0.181880 Sep 25 04:38:04.648286 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 146/346] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:04 2022] GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:38:04.707657 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-9c9e7177-7539-4e5b-8920-333a357bc656 tempest-VolumesTestJSON-2103695149 tempest-VolumesTestJSON-2103695149-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.097636 Sep 25 04:38:04.708477 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 201/347] 10.222.0.25 () {58 vars in 1170 bytes} [Sun Sep 25 04:38:04 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 04:38:04.723704 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-c9dcdb88-33c2-4774-a404-5517d4ebd16f tempest-VolumesTestJSON-2103695149 tempest-VolumesTestJSON-2103695149-project] Calling method '.version_select at 0x7f4d3f05b790>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:04.803919 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-c9dcdb88-33c2-4774-a404-5517d4ebd16f tempest-VolumesTestJSON-2103695149 tempest-VolumesTestJSON-2103695149-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.083933 Sep 25 04:38:04.804524 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 147/348] 10.222.0.25 () {58 vars in 1155 bytes} [Sun Sep 25 04:38:04 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:04.818023 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-78de0a0a-c3c7-4c5f-a65b-dcbd331a1c51 tempest-VolumesTestJSON-2103695149 tempest-VolumesTestJSON-2103695149-project] Calling method '.version_select at 0x7f4d3ef835e0>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:04.848237 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-acc3858c-c479-45de-8819-08afb2aebd1c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:04.848877 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-acc3858c-c479-45de-8819-08afb2aebd1c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 8a4fe760-3afd-42e5-9909-86ca268c9b96] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:04.854971 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-acc3858c-c479-45de-8819-08afb2aebd1c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:04.855453 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-acc3858c-c479-45de-8819-08afb2aebd1c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:04.855893 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-acc3858c-c479-45de-8819-08afb2aebd1c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:04.856581 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-acc3858c-c479-45de-8819-08afb2aebd1c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:04.857065 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-acc3858c-c479-45de-8819-08afb2aebd1c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:04.857490 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-acc3858c-c479-45de-8819-08afb2aebd1c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:04.902258 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-78de0a0a-c3c7-4c5f-a65b-dcbd331a1c51 tempest-VolumesTestJSON-2103695149 tempest-VolumesTestJSON-2103695149-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.087323 Sep 25 04:38:04.902984 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 202/349] 10.222.0.25 () {58 vars in 1188 bytes} [Sun Sep 25 04:38:04 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:38:04.916013 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-9037e43d-9eab-4380-b1a0-7ebca8a5adc5 tempest-VolumesTestJSON-2103695149 tempest-VolumesTestJSON-2103695149-project] Calling method '.version_select at 0x7f4d3ef1d820>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:04.997981 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-acc3858c-c479-45de-8819-08afb2aebd1c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:05.005535 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-9037e43d-9eab-4380-b1a0-7ebca8a5adc5 tempest-VolumesTestJSON-2103695149 tempest-VolumesTestJSON-2103695149-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.093069 Sep 25 04:38:05.005677 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-acc3858c-c479-45de-8819-08afb2aebd1c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96" status: 200 len: 1522 microversion: 2.1 time: 0.161193 Sep 25 04:38:05.006167 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 203/350] 10.222.0.25 () {58 vars in 1155 bytes} [Sun Sep 25 04:38:04 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:38:05.006313 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 148/351] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:04 2022] GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:38:05.670217 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-6959f97c-648d-4005-ac82-67d56a846651 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:05.671445 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-6959f97c-648d-4005-ac82-67d56a846651 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: d6138f3e-a927-4d61-890c-ccd60213e4f2] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:05.677981 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6959f97c-648d-4005-ac82-67d56a846651 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:05.678481 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6959f97c-648d-4005-ac82-67d56a846651 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:05.678918 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6959f97c-648d-4005-ac82-67d56a846651 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:05.679607 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6959f97c-648d-4005-ac82-67d56a846651 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:05.680062 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6959f97c-648d-4005-ac82-67d56a846651 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:05.680490 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6959f97c-648d-4005-ac82-67d56a846651 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:05.816676 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-6959f97c-648d-4005-ac82-67d56a846651 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:05.824543 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-6959f97c-648d-4005-ac82-67d56a846651 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2" status: 200 len: 1265 microversion: 2.1 time: 0.158242 Sep 25 04:38:05.825137 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 149/352] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:05 2022] GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:06.030436 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-5d941473-25c2-48ca-ab62-fcf509e0b3b2 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:06.031114 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-5d941473-25c2-48ca-ab62-fcf509e0b3b2 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 8a4fe760-3afd-42e5-9909-86ca268c9b96] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:06.037294 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5d941473-25c2-48ca-ab62-fcf509e0b3b2 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:06.037773 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5d941473-25c2-48ca-ab62-fcf509e0b3b2 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:06.038203 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5d941473-25c2-48ca-ab62-fcf509e0b3b2 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:06.038878 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5d941473-25c2-48ca-ab62-fcf509e0b3b2 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:06.039326 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5d941473-25c2-48ca-ab62-fcf509e0b3b2 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:06.039779 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5d941473-25c2-48ca-ab62-fcf509e0b3b2 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:06.290547 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-5d941473-25c2-48ca-ab62-fcf509e0b3b2 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:06.298677 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-5d941473-25c2-48ca-ab62-fcf509e0b3b2 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96" status: 200 len: 1522 microversion: 2.1 time: 0.272884 Sep 25 04:38:06.299241 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 204/353] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:06 2022] GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:06.849057 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-dd77f23f-d1a6-4766-afdd-929cbb246632 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:06.849819 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-dd77f23f-d1a6-4766-afdd-929cbb246632 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: d6138f3e-a927-4d61-890c-ccd60213e4f2] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:06.857544 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-dd77f23f-d1a6-4766-afdd-929cbb246632 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:06.858161 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-dd77f23f-d1a6-4766-afdd-929cbb246632 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:06.858768 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-dd77f23f-d1a6-4766-afdd-929cbb246632 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:06.859681 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-dd77f23f-d1a6-4766-afdd-929cbb246632 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:06.860302 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-dd77f23f-d1a6-4766-afdd-929cbb246632 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:06.860774 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-dd77f23f-d1a6-4766-afdd-929cbb246632 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:07.027811 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-dd77f23f-d1a6-4766-afdd-929cbb246632 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:07.035500 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-dd77f23f-d1a6-4766-afdd-929cbb246632 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2" status: 200 len: 1265 microversion: 2.1 time: 0.191092 Sep 25 04:38:07.036063 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 150/354] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:06 2022] GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:38:07.322314 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-fe85bdc6-badd-4c4f-b0ec-ac738ea1964a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:07.323560 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-fe85bdc6-badd-4c4f-b0ec-ac738ea1964a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 8a4fe760-3afd-42e5-9909-86ca268c9b96] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:07.329521 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fe85bdc6-badd-4c4f-b0ec-ac738ea1964a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:07.330017 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fe85bdc6-badd-4c4f-b0ec-ac738ea1964a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:07.330468 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fe85bdc6-badd-4c4f-b0ec-ac738ea1964a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:07.331397 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fe85bdc6-badd-4c4f-b0ec-ac738ea1964a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:07.331860 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fe85bdc6-badd-4c4f-b0ec-ac738ea1964a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:07.332438 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fe85bdc6-badd-4c4f-b0ec-ac738ea1964a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:07.471530 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-fe85bdc6-badd-4c4f-b0ec-ac738ea1964a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:07.480528 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-fe85bdc6-badd-4c4f-b0ec-ac738ea1964a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96" status: 200 len: 1522 microversion: 2.1 time: 0.161872 Sep 25 04:38:07.481349 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 205/355] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:07 2022] GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:08.058155 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-ba6fea87-434d-4c0d-9f1a-55f43f950eb3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:08.058766 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-ba6fea87-434d-4c0d-9f1a-55f43f950eb3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: d6138f3e-a927-4d61-890c-ccd60213e4f2] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:08.065181 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ba6fea87-434d-4c0d-9f1a-55f43f950eb3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:08.065667 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ba6fea87-434d-4c0d-9f1a-55f43f950eb3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:08.066131 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ba6fea87-434d-4c0d-9f1a-55f43f950eb3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:08.066844 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ba6fea87-434d-4c0d-9f1a-55f43f950eb3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:08.067303 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ba6fea87-434d-4c0d-9f1a-55f43f950eb3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:08.067725 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ba6fea87-434d-4c0d-9f1a-55f43f950eb3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:08.438129 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-ba6fea87-434d-4c0d-9f1a-55f43f950eb3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:08.446194 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-ba6fea87-434d-4c0d-9f1a-55f43f950eb3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2" status: 200 len: 1265 microversion: 2.1 time: 0.392353 Sep 25 04:38:08.446761 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 151/356] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:08 2022] GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2 => generated 1265 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:08.503812 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-4343d218-701c-4445-ac14-a3b1b623451e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:08.504484 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-4343d218-701c-4445-ac14-a3b1b623451e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 8a4fe760-3afd-42e5-9909-86ca268c9b96] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:08.510861 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4343d218-701c-4445-ac14-a3b1b623451e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:08.511390 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4343d218-701c-4445-ac14-a3b1b623451e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:08.511819 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4343d218-701c-4445-ac14-a3b1b623451e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:08.512540 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4343d218-701c-4445-ac14-a3b1b623451e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:08.513049 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4343d218-701c-4445-ac14-a3b1b623451e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:08.513478 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4343d218-701c-4445-ac14-a3b1b623451e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:08.662596 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-4343d218-701c-4445-ac14-a3b1b623451e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:08.673088 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-4343d218-701c-4445-ac14-a3b1b623451e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96" status: 200 len: 1522 microversion: 2.1 time: 0.173029 Sep 25 04:38:08.673806 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 206/357] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:08 2022] GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:09.470376 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-332aa4e3-ec0b-42f6-95c1-d1d5a336aa64 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:09.471264 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-332aa4e3-ec0b-42f6-95c1-d1d5a336aa64 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: d6138f3e-a927-4d61-890c-ccd60213e4f2] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:09.482330 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-332aa4e3-ec0b-42f6-95c1-d1d5a336aa64 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:09.482828 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-332aa4e3-ec0b-42f6-95c1-d1d5a336aa64 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:09.483287 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-332aa4e3-ec0b-42f6-95c1-d1d5a336aa64 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:09.485865 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-332aa4e3-ec0b-42f6-95c1-d1d5a336aa64 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:09.486430 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-332aa4e3-ec0b-42f6-95c1-d1d5a336aa64 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:09.486874 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-332aa4e3-ec0b-42f6-95c1-d1d5a336aa64 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:09.697368 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-97231a31-5f89-4b8f-9b36-da20aabefe56 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:09.698680 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-97231a31-5f89-4b8f-9b36-da20aabefe56 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 8a4fe760-3afd-42e5-9909-86ca268c9b96] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:09.705135 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-97231a31-5f89-4b8f-9b36-da20aabefe56 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:09.705633 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-97231a31-5f89-4b8f-9b36-da20aabefe56 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:09.706076 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-97231a31-5f89-4b8f-9b36-da20aabefe56 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:09.706815 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-97231a31-5f89-4b8f-9b36-da20aabefe56 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:09.707954 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-97231a31-5f89-4b8f-9b36-da20aabefe56 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:09.708735 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-97231a31-5f89-4b8f-9b36-da20aabefe56 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:09.725734 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-332aa4e3-ec0b-42f6-95c1-d1d5a336aa64 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:09.735098 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-332aa4e3-ec0b-42f6-95c1-d1d5a336aa64 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2" status: 200 len: 1265 microversion: 2.1 time: 0.268621 Sep 25 04:38:09.735759 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 152/358] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:09 2022] GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2 => generated 1265 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:09.937552 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-97231a31-5f89-4b8f-9b36-da20aabefe56 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:09.952423 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-97231a31-5f89-4b8f-9b36-da20aabefe56 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96" status: 200 len: 1502 microversion: 2.1 time: 0.259272 Sep 25 04:38:09.954071 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 207/359] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:09 2022] GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96 => generated 1502 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:38:09.984474 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-dda1703d-6a05-4235-86b5-f49dde0f08dd tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0eba56d6-c40b-4056-ac38-c16b13a3a2e1"}} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:38:09.984474 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-dda1703d-6a05-4235-86b5-f49dde0f08dd tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 8a4fe760-3afd-42e5-9909-86ca268c9b96] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:09.990642 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-dda1703d-6a05-4235-86b5-f49dde0f08dd tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:09.991153 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-dda1703d-6a05-4235-86b5-f49dde0f08dd tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:09.991599 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-dda1703d-6a05-4235-86b5-f49dde0f08dd tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:09.992312 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-dda1703d-6a05-4235-86b5-f49dde0f08dd tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:09.992894 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-dda1703d-6a05-4235-86b5-f49dde0f08dd tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:09.993227 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-dda1703d-6a05-4235-86b5-f49dde0f08dd tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:10.024049 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.wsgi [None req-dda1703d-6a05-4235-86b5-f49dde0f08dd tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] HTTP exception thrown: Cannot 'attach_volume' instance 8a4fe760-3afd-42e5-9909-86ca268c9b96 while it is in vm_state rescued Sep 25 04:38:10.026269 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-dda1703d-6a05-4235-86b5-f49dde0f08dd tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Request method failure captured: Sep 25 04:38:10.026269 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: request: POST /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96/os-volume_attachments HTTP/1.1 Sep 25 04:38:10.026269 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept: application/json Sep 25 04:38:10.026269 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept-Encoding: identity Sep 25 04:38:10.026269 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Connection: close Sep 25 04:38:10.026269 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Length: 74 Sep 25 04:38:10.026269 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Type: application/json Sep 25 04:38:10.026269 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Host: 10.222.0.25 Sep 25 04:38:10.026269 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Openstack-System-Scope: None Sep 25 04:38:10.026269 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: User-Agent: python-urllib3/1.26.12 Sep 25 04:38:10.026269 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Auth-Token: gAAAAABjL9qqgx9SbwmoscMIXzayDkTaHYe5OsS0R6Y7sMCrDveP0He2ve1AWmZoJjvfku9MDTwEaVSQrNi9P0Yo8NZuEWbmT7VIGNUqGQXykMqiQxqIQpHToYGErquEQDCjI-WfO-ZEE9ccXdKRhNCVIGSYzSyMRRtPFFdQShrVaJWdWp_RDEI Sep 25 04:38:10.026269 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Id: None Sep 25 04:38:10.026269 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Name: None Sep 25 04:38:10.026269 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Identity-Status: Confirmed Sep 25 04:38:10.026269 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Is-Admin-Project: True Sep 25 04:38:10.026269 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Id: default Sep 25 04:38:10.026269 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Name: Default Sep 25 04:38:10.026269 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Id: f6f23cf0323f48069e21acf059cbd1f0 Sep 25 04:38:10.026269 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1236487579 Sep 25 04:38:10.026269 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Role: reader,member Sep 25 04:38:10.026269 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Roles: reader,member Sep 25 04:38:10.027889 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f6f23cf0323f48069e21acf059cbd1f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6f23cf0323f48069e21acf059cbd1f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6f23cf0323f48069e21acf059cbd1f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f6f23cf0323f48069e21acf059cbd1f0"}]}] Sep 25 04:38:10.027889 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1236487579 Sep 25 04:38:10.027889 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Id: f6f23cf0323f48069e21acf059cbd1f0 Sep 25 04:38:10.027889 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1236487579 Sep 25 04:38:10.027889 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User: tempest-ServerRescueNegativeTestJSON-1236487579-project Sep 25 04:38:10.027889 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Id: default Sep 25 04:38:10.027889 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Name: Default Sep 25 04:38:10.027889 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Id: 2666d4774776498bbdbce539296e76a9 Sep 25 04:38:10.027889 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1236487579-project Sep 25 04:38:10.027889 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Sep 25 04:38:10.027889 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: {"volumeAttachment": {"volumeId": "0eba56d6-c40b-4056-ac38-c16b13a3a2e1"}} Sep 25 04:38:10.027889 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: method: > Sep 25 04:38:10.029231 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: exception: Cannot 'attach_volume' instance 8a4fe760-3afd-42e5-9909-86ca268c9b96 while it is in vm_state rescued Sep 25 04:38:10.029231 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: action_args: {'server_id': '8a4fe760-3afd-42e5-9909-86ca268c9b96', 'body': {'volumeAttachment': {'volumeId': '0eba56d6-c40b-4056-ac38-c16b13a3a2e1'}}} Sep 25 04:38:10.029231 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:38:10.029231 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:38:10.029231 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 25 04:38:10.029231 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 25 04:38:10.029231 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 25 04:38:10.029231 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 25 04:38:10.029231 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 25 04:38:10.029231 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 25 04:38:10.029231 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8a4fe760-3afd-42e5-9909-86ca268c9b96 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 25 04:38:10.029231 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:38:10.029231 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:38:10.029231 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:38:10.029231 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:38:10.029231 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:38:10.029231 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:38:10.029231 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:38:10.029231 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:38:10.030653 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:38:10.030653 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:38:10.030653 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 04:38:10.030653 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 04:38:10.030653 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 04:38:10.030653 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 04:38:10.030653 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 04:38:10.030653 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 04:38:10.030653 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 25 04:38:10.030653 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 25 04:38:10.030653 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 25 04:38:10.030653 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 25 04:38:10.030653 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 8a4fe760-3afd-42e5-9909-86ca268c9b96 while it is in vm_state rescued Sep 25 04:38:10.030653 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:38:10.030653 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:38:10.030653 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:38:10.030653 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:38:10.030653 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:38:10.030653 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:38:10.032136 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:38:10.032136 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:38:10.032136 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 8a4fe760-3afd-42e5-9909-86ca268c9b96 while it is in vm_state rescued Sep 25 04:38:10.032136 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:38:10.032136 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-dda1703d-6a05-4235-86b5-f49dde0f08dd tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Returning 409 to user: Cannot 'attach_volume' instance 8a4fe760-3afd-42e5-9909-86ca268c9b96 while it is in vm_state rescued {{(pid=127141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:38:10.032136 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-dda1703d-6a05-4235-86b5-f49dde0f08dd tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "POST /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.056080 Sep 25 04:38:10.032136 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 153/360] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Sep 25 04:38:09 2022] POST /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96/os-volume_attachments => generated 152 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 25 04:38:10.037196 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-931a351d-aa1d-43a7-ada4-6077b110f327 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:38:10.037740 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-931a351d-aa1d-43a7-ada4-6077b110f327 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 8a4fe760-3afd-42e5-9909-86ca268c9b96] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:10.044177 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-931a351d-aa1d-43a7-ada4-6077b110f327 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:10.044680 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-931a351d-aa1d-43a7-ada4-6077b110f327 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:10.045122 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-931a351d-aa1d-43a7-ada4-6077b110f327 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:10.045825 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-931a351d-aa1d-43a7-ada4-6077b110f327 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:10.046284 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-931a351d-aa1d-43a7-ada4-6077b110f327 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:10.046711 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-931a351d-aa1d-43a7-ada4-6077b110f327 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:10.117307 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-931a351d-aa1d-43a7-ada4-6077b110f327 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "POST /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96/action" status: 202 len: 0 microversion: 2.1 time: 0.083789 Sep 25 04:38:10.118375 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 208/361] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 25 04:38:10 2022] POST /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 04:38:10.128278 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-91a4f19b-c259-43b9-92d5-ad7ed3866fd5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:10.129009 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-91a4f19b-c259-43b9-92d5-ad7ed3866fd5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 8a4fe760-3afd-42e5-9909-86ca268c9b96] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:10.135893 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-91a4f19b-c259-43b9-92d5-ad7ed3866fd5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:10.136696 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-91a4f19b-c259-43b9-92d5-ad7ed3866fd5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:10.137200 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-91a4f19b-c259-43b9-92d5-ad7ed3866fd5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:10.138012 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-91a4f19b-c259-43b9-92d5-ad7ed3866fd5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:10.138658 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-91a4f19b-c259-43b9-92d5-ad7ed3866fd5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:10.139322 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-91a4f19b-c259-43b9-92d5-ad7ed3866fd5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:10.380529 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-91a4f19b-c259-43b9-92d5-ad7ed3866fd5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:10.389327 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-91a4f19b-c259-43b9-92d5-ad7ed3866fd5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96" status: 200 len: 1510 microversion: 2.1 time: 0.266215 Sep 25 04:38:10.390340 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 154/362] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:10 2022] GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96 => generated 1510 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:38:10.758994 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-c7161ffc-b4fe-41b8-93d8-c537c27e6ead tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:10.759617 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-c7161ffc-b4fe-41b8-93d8-c537c27e6ead tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: d6138f3e-a927-4d61-890c-ccd60213e4f2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:10.766055 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c7161ffc-b4fe-41b8-93d8-c537c27e6ead tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:10.766549 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c7161ffc-b4fe-41b8-93d8-c537c27e6ead tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:10.767194 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c7161ffc-b4fe-41b8-93d8-c537c27e6ead tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:10.767900 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c7161ffc-b4fe-41b8-93d8-c537c27e6ead tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:10.768357 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c7161ffc-b4fe-41b8-93d8-c537c27e6ead tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:10.768820 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c7161ffc-b4fe-41b8-93d8-c537c27e6ead tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:10.816701 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell0:SELECT=2 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:38:10.833096 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell0:SELECT=6 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:38:10.921965 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-c7161ffc-b4fe-41b8-93d8-c537c27e6ead tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:10.929766 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-c7161ffc-b4fe-41b8-93d8-c537c27e6ead tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2" status: 200 len: 1265 microversion: 2.1 time: 0.175587 Sep 25 04:38:10.930324 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 209/363] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:10 2022] GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:11.417939 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-98984028-52fe-463d-9c0e-1e8ea2052343 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:11.418596 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-98984028-52fe-463d-9c0e-1e8ea2052343 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 8a4fe760-3afd-42e5-9909-86ca268c9b96] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:11.421036 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell0:SELECT=2 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:38:11.427171 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-98984028-52fe-463d-9c0e-1e8ea2052343 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:11.427860 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-98984028-52fe-463d-9c0e-1e8ea2052343 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:11.428271 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-98984028-52fe-463d-9c0e-1e8ea2052343 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:11.429132 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-98984028-52fe-463d-9c0e-1e8ea2052343 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:11.429726 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-98984028-52fe-463d-9c0e-1e8ea2052343 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:11.430259 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-98984028-52fe-463d-9c0e-1e8ea2052343 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:11.593331 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-98984028-52fe-463d-9c0e-1e8ea2052343 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:11.601997 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-98984028-52fe-463d-9c0e-1e8ea2052343 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96" status: 200 len: 1510 microversion: 2.1 time: 0.190254 Sep 25 04:38:11.602552 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 155/364] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:11 2022] GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96 => generated 1510 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:11.953502 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-7940f775-87a2-493e-974c-3fb94eeb8e9a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:11.954107 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-7940f775-87a2-493e-974c-3fb94eeb8e9a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: d6138f3e-a927-4d61-890c-ccd60213e4f2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:11.960336 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7940f775-87a2-493e-974c-3fb94eeb8e9a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:11.960859 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7940f775-87a2-493e-974c-3fb94eeb8e9a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:11.961293 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7940f775-87a2-493e-974c-3fb94eeb8e9a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:11.961970 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7940f775-87a2-493e-974c-3fb94eeb8e9a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:11.962419 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7940f775-87a2-493e-974c-3fb94eeb8e9a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:11.962837 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7940f775-87a2-493e-974c-3fb94eeb8e9a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:12.101420 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-7940f775-87a2-493e-974c-3fb94eeb8e9a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:12.109276 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-7940f775-87a2-493e-974c-3fb94eeb8e9a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2" status: 200 len: 1265 microversion: 2.1 time: 0.159656 Sep 25 04:38:12.109826 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 210/365] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:11 2022] GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:12.626213 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-c24ee967-98d8-40cd-b05e-85d4477276f0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:12.626827 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-c24ee967-98d8-40cd-b05e-85d4477276f0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 8a4fe760-3afd-42e5-9909-86ca268c9b96] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:12.633877 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c24ee967-98d8-40cd-b05e-85d4477276f0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:12.634366 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c24ee967-98d8-40cd-b05e-85d4477276f0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:12.634809 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c24ee967-98d8-40cd-b05e-85d4477276f0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:12.636220 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c24ee967-98d8-40cd-b05e-85d4477276f0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:12.636722 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c24ee967-98d8-40cd-b05e-85d4477276f0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:12.637183 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c24ee967-98d8-40cd-b05e-85d4477276f0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:12.765538 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-c24ee967-98d8-40cd-b05e-85d4477276f0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:12.773178 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-c24ee967-98d8-40cd-b05e-85d4477276f0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96" status: 200 len: 1510 microversion: 2.1 time: 0.150890 Sep 25 04:38:12.773745 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 156/366] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:12 2022] GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:13.131252 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-70ddac17-cedd-4a27-81ad-2364870b856d tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:13.131857 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-70ddac17-cedd-4a27-81ad-2364870b856d tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: d6138f3e-a927-4d61-890c-ccd60213e4f2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:13.138179 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-70ddac17-cedd-4a27-81ad-2364870b856d tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:13.138694 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-70ddac17-cedd-4a27-81ad-2364870b856d tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:13.139128 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-70ddac17-cedd-4a27-81ad-2364870b856d tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:13.139885 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-70ddac17-cedd-4a27-81ad-2364870b856d tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:13.140343 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-70ddac17-cedd-4a27-81ad-2364870b856d tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:13.140816 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-70ddac17-cedd-4a27-81ad-2364870b856d tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:13.282038 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-70ddac17-cedd-4a27-81ad-2364870b856d tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:13.289728 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-70ddac17-cedd-4a27-81ad-2364870b856d tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2" status: 200 len: 1265 microversion: 2.1 time: 0.162356 Sep 25 04:38:13.290295 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 211/367] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:13 2022] GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:13.796696 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-40a4b7b1-9f1c-4d98-8510-65f4333acdcc tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:13.797536 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-40a4b7b1-9f1c-4d98-8510-65f4333acdcc tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 8a4fe760-3afd-42e5-9909-86ca268c9b96] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:13.804053 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-40a4b7b1-9f1c-4d98-8510-65f4333acdcc tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:13.804572 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-40a4b7b1-9f1c-4d98-8510-65f4333acdcc tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:13.811315 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-40a4b7b1-9f1c-4d98-8510-65f4333acdcc tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:13.812180 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-40a4b7b1-9f1c-4d98-8510-65f4333acdcc tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:13.812682 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-40a4b7b1-9f1c-4d98-8510-65f4333acdcc tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:13.813125 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-40a4b7b1-9f1c-4d98-8510-65f4333acdcc tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:13.955024 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-40a4b7b1-9f1c-4d98-8510-65f4333acdcc tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:13.963139 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-40a4b7b1-9f1c-4d98-8510-65f4333acdcc tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96" status: 200 len: 1510 microversion: 2.1 time: 0.170369 Sep 25 04:38:13.964332 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 157/368] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:13 2022] GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96 => generated 1510 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:38:14.312805 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-016d1097-92d9-4ada-b7cf-5dc690b963ae tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:14.313342 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-016d1097-92d9-4ada-b7cf-5dc690b963ae tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: d6138f3e-a927-4d61-890c-ccd60213e4f2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:14.319258 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-016d1097-92d9-4ada-b7cf-5dc690b963ae tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:14.319741 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-016d1097-92d9-4ada-b7cf-5dc690b963ae tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:14.320179 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-016d1097-92d9-4ada-b7cf-5dc690b963ae tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:14.320887 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-016d1097-92d9-4ada-b7cf-5dc690b963ae tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:14.321359 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-016d1097-92d9-4ada-b7cf-5dc690b963ae tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:14.321781 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-016d1097-92d9-4ada-b7cf-5dc690b963ae tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:14.456707 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-016d1097-92d9-4ada-b7cf-5dc690b963ae tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:14.465600 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-016d1097-92d9-4ada-b7cf-5dc690b963ae tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2" status: 200 len: 1265 microversion: 2.1 time: 0.156772 Sep 25 04:38:14.466165 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 212/369] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:14 2022] GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:14.990332 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-a9f10d9a-1384-4c97-9762-df15087c3693 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:14.990983 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-a9f10d9a-1384-4c97-9762-df15087c3693 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 8a4fe760-3afd-42e5-9909-86ca268c9b96] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:14.998826 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a9f10d9a-1384-4c97-9762-df15087c3693 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:14.999348 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a9f10d9a-1384-4c97-9762-df15087c3693 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:15.000591 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a9f10d9a-1384-4c97-9762-df15087c3693 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:15.001433 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a9f10d9a-1384-4c97-9762-df15087c3693 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:15.001990 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a9f10d9a-1384-4c97-9762-df15087c3693 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:15.002422 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a9f10d9a-1384-4c97-9762-df15087c3693 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:15.149049 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-a9f10d9a-1384-4c97-9762-df15087c3693 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:15.156919 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-a9f10d9a-1384-4c97-9762-df15087c3693 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96" status: 200 len: 1516 microversion: 2.1 time: 0.174037 Sep 25 04:38:15.157485 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 158/370] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:14 2022] GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96 => generated 1516 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:15.488883 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-8fc117a6-3c1f-4c4b-9c6f-d212fdfc809b tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:15.489561 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-8fc117a6-3c1f-4c4b-9c6f-d212fdfc809b tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: d6138f3e-a927-4d61-890c-ccd60213e4f2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:15.497539 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8fc117a6-3c1f-4c4b-9c6f-d212fdfc809b tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:15.498537 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8fc117a6-3c1f-4c4b-9c6f-d212fdfc809b tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:15.499095 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8fc117a6-3c1f-4c4b-9c6f-d212fdfc809b tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:15.499879 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8fc117a6-3c1f-4c4b-9c6f-d212fdfc809b tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:15.500418 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8fc117a6-3c1f-4c4b-9c6f-d212fdfc809b tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:15.500932 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8fc117a6-3c1f-4c4b-9c6f-d212fdfc809b tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:15.644573 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-8fc117a6-3c1f-4c4b-9c6f-d212fdfc809b tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:15.652767 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-8fc117a6-3c1f-4c4b-9c6f-d212fdfc809b tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2" status: 200 len: 1265 microversion: 2.1 time: 0.167437 Sep 25 04:38:15.653342 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 213/371] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:15 2022] GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:16.676913 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-bf76a4d3-6397-4809-b09b-82fc2e5c8265 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:16.677554 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-bf76a4d3-6397-4809-b09b-82fc2e5c8265 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: d6138f3e-a927-4d61-890c-ccd60213e4f2] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:16.684240 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bf76a4d3-6397-4809-b09b-82fc2e5c8265 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:16.684756 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bf76a4d3-6397-4809-b09b-82fc2e5c8265 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:16.685196 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bf76a4d3-6397-4809-b09b-82fc2e5c8265 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:16.685940 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bf76a4d3-6397-4809-b09b-82fc2e5c8265 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:16.686434 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bf76a4d3-6397-4809-b09b-82fc2e5c8265 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:16.686860 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bf76a4d3-6397-4809-b09b-82fc2e5c8265 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:16.826734 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-bf76a4d3-6397-4809-b09b-82fc2e5c8265 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:16.835736 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-bf76a4d3-6397-4809-b09b-82fc2e5c8265 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2" status: 200 len: 1265 microversion: 2.1 time: 0.163811 Sep 25 04:38:16.836302 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 159/372] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:16 2022] GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:17.598175 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-508f25ad-cf1d-42f3-8721-730e6fad23ab tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Action: 'create', calling method: .version_select at 0x7f4d3ef7fd30>, body: {"keypair": {"name": "tempest-keypair-559871816", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBUNE8nHhQgu8BGW6x4MeruZvEc4UpR5+mYltKxMmqsjn3MD94jdCaWDj4BABDajhjywUTnqWkqkIe4u0cmsttcIow+2mY+lwWHHriD7MY03cRVSRwwlOGajH4cumuaHw=="}} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:38:17.614006 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.quota [None req-508f25ad-cf1d-42f3-8721-730e6fad23ab tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Getting quotas for project f6f23cf0323f48069e21acf059cbd1f0. Resources: {'key_pairs'} {{(pid=127142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 04:38:17.618746 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.quota [None req-508f25ad-cf1d-42f3-8721-730e6fad23ab tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Getting quotas for user 2666d4774776498bbdbce539296e76a9 and project f6f23cf0323f48069e21acf059cbd1f0. Resources: {'key_pairs'} {{(pid=127142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 04:38:17.642280 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-508f25ad-cf1d-42f3-8721-730e6fad23ab tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047825 Sep 25 04:38:17.642886 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 214/373] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 25 04:38:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:38:17.863239 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-9532f39b-2f81-4d1f-a91a-ad93db3e45a1 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:17.863954 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-9532f39b-2f81-4d1f-a91a-ad93db3e45a1 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: d6138f3e-a927-4d61-890c-ccd60213e4f2] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:17.872474 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9532f39b-2f81-4d1f-a91a-ad93db3e45a1 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:17.873574 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9532f39b-2f81-4d1f-a91a-ad93db3e45a1 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:17.874502 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9532f39b-2f81-4d1f-a91a-ad93db3e45a1 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:17.875806 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9532f39b-2f81-4d1f-a91a-ad93db3e45a1 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:17.876574 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9532f39b-2f81-4d1f-a91a-ad93db3e45a1 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:17.877061 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9532f39b-2f81-4d1f-a91a-ad93db3e45a1 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:18.036871 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-9532f39b-2f81-4d1f-a91a-ad93db3e45a1 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:18.045906 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-9532f39b-2f81-4d1f-a91a-ad93db3e45a1 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2" status: 200 len: 1265 microversion: 2.1 time: 0.187572 Sep 25 04:38:18.046585 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 160/374] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:17 2022] GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:38:19.061937 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-5a32ee43-ee92-402b-8ec9-6b874e0c38bc tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-580314786", "imageRef": "e5cfdbb2-d0ce-4736-b311-1a3c155844e9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "80b6de49-451b-443e-9218-1f0470a46dc2"}], "security_groups": [{"name": "tempest-securitygroup--528171088"}], "key_name": "tempest-keypair-559871816", "user_data": "}} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:38:19.069236 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-5bde4d75-9639-4b31-8dcb-8ab140eb7133 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:19.069844 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-5bde4d75-9639-4b31-8dcb-8ab140eb7133 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: d6138f3e-a927-4d61-890c-ccd60213e4f2] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:19.076921 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5bde4d75-9639-4b31-8dcb-8ab140eb7133 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:19.077417 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5bde4d75-9639-4b31-8dcb-8ab140eb7133 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:19.077856 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5bde4d75-9639-4b31-8dcb-8ab140eb7133 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:19.078560 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5bde4d75-9639-4b31-8dcb-8ab140eb7133 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:19.079018 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5bde4d75-9639-4b31-8dcb-8ab140eb7133 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:19.079446 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5bde4d75-9639-4b31-8dcb-8ab140eb7133 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:19.085172 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=100 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:38:19.222218 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.network.neutron [None req-5a32ee43-ee92-402b-8ec9-6b874e0c38bc tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] validate_networks() for [('80b6de49-451b-443e-9218-1f0470a46dc2', None, None, None, None, None)] {{(pid=127142) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 04:38:19.301174 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-5bde4d75-9639-4b31-8dcb-8ab140eb7133 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:19.311771 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-5bde4d75-9639-4b31-8dcb-8ab140eb7133 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2" status: 200 len: 1265 microversion: 2.1 time: 0.245426 Sep 25 04:38:19.312555 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 161/375] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:19 2022] GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2 => generated 1265 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:38:19.665522 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-5a32ee43-ee92-402b-8ec9-6b874e0c38bc tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Flavor limits 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 04:38:19.666090 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-5a32ee43-ee92-402b-8ec9-6b874e0c38bc tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Image limits 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 04:38:19.667085 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-5a32ee43-ee92-402b-8ec9-6b874e0c38bc tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Flavor pref 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 04:38:19.667830 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-5a32ee43-ee92-402b-8ec9-6b874e0c38bc tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Image pref 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 04:38:19.668419 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-5a32ee43-ee92-402b-8ec9-6b874e0c38bc tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 04:38:19.678344 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5a32ee43-ee92-402b-8ec9-6b874e0c38bc tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:19.678836 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5a32ee43-ee92-402b-8ec9-6b874e0c38bc tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:19.679385 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5a32ee43-ee92-402b-8ec9-6b874e0c38bc tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:19.680059 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5a32ee43-ee92-402b-8ec9-6b874e0c38bc tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:19.680738 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5a32ee43-ee92-402b-8ec9-6b874e0c38bc tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:19.681357 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5a32ee43-ee92-402b-8ec9-6b874e0c38bc tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:19.700473 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.quota [None req-5a32ee43-ee92-402b-8ec9-6b874e0c38bc tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Getting quotas for project f6f23cf0323f48069e21acf059cbd1f0. Resources: {'instances', 'ram', 'cores'} {{(pid=127142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 04:38:19.704609 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.quota [None req-5a32ee43-ee92-402b-8ec9-6b874e0c38bc tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Getting quotas for user 2666d4774776498bbdbce539296e76a9 and project f6f23cf0323f48069e21acf059cbd1f0. Resources: {'instances', 'ram', 'cores'} {{(pid=127142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 04:38:19.717496 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-5a32ee43-ee92-402b-8ec9-6b874e0c38bc tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Going to run 1 instances... {{(pid=127142) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 04:38:19.719840 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-5a32ee43-ee92-402b-8ec9-6b874e0c38bc tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5cfdbb2-d0ce-4736-b311-1a3c155844e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 04:38:19.768440 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-5a32ee43-ee92-402b-8ec9-6b874e0c38bc tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.711406 Sep 25 04:38:19.769295 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 215/376] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 25 04:38:19 2022] POST /compute/v2.1/servers => generated 408 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 04:38:19.782371 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-604ab524-9997-472f-a973-f525f5be5141 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:19.782985 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-604ab524-9997-472f-a973-f525f5be5141 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:19.851532 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-604ab524-9997-472f-a973-f525f5be5141 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:19.860272 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-604ab524-9997-472f-a973-f525f5be5141 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1244 microversion: 2.1 time: 0.082834 Sep 25 04:38:19.861213 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 162/377] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:19 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:20.341348 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-ced1d4d4-cac7-481c-a154-4fb97cb65a50 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:20.342204 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-ced1d4d4-cac7-481c-a154-4fb97cb65a50 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: d6138f3e-a927-4d61-890c-ccd60213e4f2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:20.349743 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ced1d4d4-cac7-481c-a154-4fb97cb65a50 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:20.350238 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ced1d4d4-cac7-481c-a154-4fb97cb65a50 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:20.350720 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ced1d4d4-cac7-481c-a154-4fb97cb65a50 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:20.351443 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ced1d4d4-cac7-481c-a154-4fb97cb65a50 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:20.351959 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ced1d4d4-cac7-481c-a154-4fb97cb65a50 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:20.352567 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ced1d4d4-cac7-481c-a154-4fb97cb65a50 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:20.499885 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-ced1d4d4-cac7-481c-a154-4fb97cb65a50 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:20.508619 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-ced1d4d4-cac7-481c-a154-4fb97cb65a50 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2" status: 200 len: 1265 microversion: 2.1 time: 0.175563 Sep 25 04:38:20.509552 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 216/378] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:20 2022] GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:20.883383 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-a7131ed1-78ab-469c-9767-b9c9ccc40025 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:20.883996 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-a7131ed1-78ab-469c-9767-b9c9ccc40025 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:20.890663 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a7131ed1-78ab-469c-9767-b9c9ccc40025 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:20.891147 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a7131ed1-78ab-469c-9767-b9c9ccc40025 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:20.891633 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a7131ed1-78ab-469c-9767-b9c9ccc40025 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:20.892574 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a7131ed1-78ab-469c-9767-b9c9ccc40025 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:20.893049 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a7131ed1-78ab-469c-9767-b9c9ccc40025 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:20.893472 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a7131ed1-78ab-469c-9767-b9c9ccc40025 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:20.961267 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-a7131ed1-78ab-469c-9767-b9c9ccc40025 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:20.969216 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-a7131ed1-78ab-469c-9767-b9c9ccc40025 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1296 microversion: 2.1 time: 0.089913 Sep 25 04:38:20.969689 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 163/379] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:20 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1296 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:21.247115 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-accb2146-1a33-44a6-942d-01da5efccc5d req-79dbbdec-0250-481b-b46a-ef6fa2bff5f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6138f3e-a927-4d61-890c-ccd60213e4f2", "name": "network-vif-plugged", "status": "completed", "tag": "9bd5cc76-3974-4656-ab0e-c104227f5d9c"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:38:21.263261 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-accb2146-1a33-44a6-942d-01da5efccc5d req-79dbbdec-0250-481b-b46a-ef6fa2bff5f5 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:21.263737 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-accb2146-1a33-44a6-942d-01da5efccc5d req-79dbbdec-0250-481b-b46a-ef6fa2bff5f5 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:21.264160 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-accb2146-1a33-44a6-942d-01da5efccc5d req-79dbbdec-0250-481b-b46a-ef6fa2bff5f5 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:21.289662 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-accb2146-1a33-44a6-942d-01da5efccc5d req-79dbbdec-0250-481b-b46a-ef6fa2bff5f5 service nova] Creating event network-vif-plugged:9bd5cc76-3974-4656-ab0e-c104227f5d9c for instance d6138f3e-a927-4d61-890c-ccd60213e4f2 on hv-cinder-85535 Sep 25 04:38:21.304318 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-accb2146-1a33-44a6-942d-01da5efccc5d req-79dbbdec-0250-481b-b46a-ef6fa2bff5f5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062276 Sep 25 04:38:21.312060 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 217/380] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:38:21.534579 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-f9afcd87-2df9-42fa-8ded-9e09ecd5beee tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:21.535599 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-f9afcd87-2df9-42fa-8ded-9e09ecd5beee tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: d6138f3e-a927-4d61-890c-ccd60213e4f2] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:21.543568 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f9afcd87-2df9-42fa-8ded-9e09ecd5beee tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:21.545072 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f9afcd87-2df9-42fa-8ded-9e09ecd5beee tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:21.545805 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f9afcd87-2df9-42fa-8ded-9e09ecd5beee tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:21.546643 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f9afcd87-2df9-42fa-8ded-9e09ecd5beee tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:21.547351 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f9afcd87-2df9-42fa-8ded-9e09ecd5beee tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:21.548003 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f9afcd87-2df9-42fa-8ded-9e09ecd5beee tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:21.784542 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-f9afcd87-2df9-42fa-8ded-9e09ecd5beee tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:21.794038 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-f9afcd87-2df9-42fa-8ded-9e09ecd5beee tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2" status: 200 len: 1265 microversion: 2.1 time: 0.264914 Sep 25 04:38:21.794610 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 164/381] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:21 2022] GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2 => generated 1265 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:21.992567 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-989958cd-36d1-4758-8197-fe7e90639984 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:21.993294 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-989958cd-36d1-4758-8197-fe7e90639984 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:21.999739 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-989958cd-36d1-4758-8197-fe7e90639984 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:22.000205 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-989958cd-36d1-4758-8197-fe7e90639984 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:22.000671 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-989958cd-36d1-4758-8197-fe7e90639984 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:22.001375 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-989958cd-36d1-4758-8197-fe7e90639984 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:22.001853 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-989958cd-36d1-4758-8197-fe7e90639984 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:22.002372 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-989958cd-36d1-4758-8197-fe7e90639984 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:22.096161 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-989958cd-36d1-4758-8197-fe7e90639984 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:22.104608 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-989958cd-36d1-4758-8197-fe7e90639984 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1302 microversion: 2.1 time: 0.116255 Sep 25 04:38:22.105232 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 218/382] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:21 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1302 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:22.818318 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-1f189b0e-54fa-41e7-ba83-c826b9f8e345 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:22.818931 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-1f189b0e-54fa-41e7-ba83-c826b9f8e345 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: d6138f3e-a927-4d61-890c-ccd60213e4f2] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:22.827741 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1f189b0e-54fa-41e7-ba83-c826b9f8e345 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:22.828136 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1f189b0e-54fa-41e7-ba83-c826b9f8e345 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:22.828560 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1f189b0e-54fa-41e7-ba83-c826b9f8e345 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:22.829382 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1f189b0e-54fa-41e7-ba83-c826b9f8e345 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:22.829864 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1f189b0e-54fa-41e7-ba83-c826b9f8e345 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:22.830469 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1f189b0e-54fa-41e7-ba83-c826b9f8e345 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:23.131551 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-a5d84307-0af5-4fa3-b02b-01169cfc7f72 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:23.133693 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-a5d84307-0af5-4fa3-b02b-01169cfc7f72 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:23.143310 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a5d84307-0af5-4fa3-b02b-01169cfc7f72 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:23.144002 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a5d84307-0af5-4fa3-b02b-01169cfc7f72 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:23.144504 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a5d84307-0af5-4fa3-b02b-01169cfc7f72 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:23.145751 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a5d84307-0af5-4fa3-b02b-01169cfc7f72 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:23.146339 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a5d84307-0af5-4fa3-b02b-01169cfc7f72 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:23.146828 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a5d84307-0af5-4fa3-b02b-01169cfc7f72 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:23.309471 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-1f189b0e-54fa-41e7-ba83-c826b9f8e345 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:23.317720 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-1f189b0e-54fa-41e7-ba83-c826b9f8e345 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2" status: 200 len: 1265 microversion: 2.1 time: 0.503183 Sep 25 04:38:23.318299 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 165/383] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:22 2022] GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2 => generated 1265 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:23.391915 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-a5d84307-0af5-4fa3-b02b-01169cfc7f72 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:23.397136 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:38:23.404234 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-a5d84307-0af5-4fa3-b02b-01169cfc7f72 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1369 microversion: 2.1 time: 0.279223 Sep 25 04:38:23.417760 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 219/384] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:23 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1369 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:38:23.498187 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [req-355cb495-d84a-4faa-aeaf-aacdab46dce0 req-89776546-a562-40b2-87d9-b4ba04157c30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1348d173-f0db-4d60-94f5-1765387d7294", "tag": "200b52b7-c7da-4e8b-924a-5151390b5778"}]} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:38:23.509025 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-355cb495-d84a-4faa-aeaf-aacdab46dce0 req-89776546-a562-40b2-87d9-b4ba04157c30 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:23.509582 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-355cb495-d84a-4faa-aeaf-aacdab46dce0 req-89776546-a562-40b2-87d9-b4ba04157c30 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:23.510250 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-355cb495-d84a-4faa-aeaf-aacdab46dce0 req-89776546-a562-40b2-87d9-b4ba04157c30 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:23.521215 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.compute.server_external_events [req-355cb495-d84a-4faa-aeaf-aacdab46dce0 req-89776546-a562-40b2-87d9-b4ba04157c30 service nova] Creating event network-changed:200b52b7-c7da-4e8b-924a-5151390b5778 for instance 1348d173-f0db-4d60-94f5-1765387d7294 on hv-cinder-85535 Sep 25 04:38:23.526247 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [req-355cb495-d84a-4faa-aeaf-aacdab46dce0 req-89776546-a562-40b2-87d9-b4ba04157c30 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035539 Sep 25 04:38:23.526914 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 166/385] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 04:38:24.343365 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-d2c1e228-5acb-440b-a74c-e16ed76847cd tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:24.344700 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-d2c1e228-5acb-440b-a74c-e16ed76847cd tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: d6138f3e-a927-4d61-890c-ccd60213e4f2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:24.351435 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d2c1e228-5acb-440b-a74c-e16ed76847cd tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:24.351921 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d2c1e228-5acb-440b-a74c-e16ed76847cd tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:24.352358 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d2c1e228-5acb-440b-a74c-e16ed76847cd tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:24.353085 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d2c1e228-5acb-440b-a74c-e16ed76847cd tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:24.353564 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d2c1e228-5acb-440b-a74c-e16ed76847cd tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:24.354214 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d2c1e228-5acb-440b-a74c-e16ed76847cd tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:24.440051 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-061bede7-7e81-406a-9237-a62d7ff2fd30 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:24.440943 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-061bede7-7e81-406a-9237-a62d7ff2fd30 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:24.447130 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-061bede7-7e81-406a-9237-a62d7ff2fd30 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:24.448335 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-061bede7-7e81-406a-9237-a62d7ff2fd30 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:24.449001 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-061bede7-7e81-406a-9237-a62d7ff2fd30 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:24.449714 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-061bede7-7e81-406a-9237-a62d7ff2fd30 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:24.450178 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-061bede7-7e81-406a-9237-a62d7ff2fd30 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:24.450613 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-061bede7-7e81-406a-9237-a62d7ff2fd30 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:24.580465 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-d2c1e228-5acb-440b-a74c-e16ed76847cd tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:24.588623 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-d2c1e228-5acb-440b-a74c-e16ed76847cd tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2" status: 200 len: 1452 microversion: 2.1 time: 0.251495 Sep 25 04:38:24.589483 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 220/386] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:24 2022] GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2 => generated 1452 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:24.612443 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-484a5500-48c2-4990-bf8b-5f8930311b28 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:24.613334 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-484a5500-48c2-4990-bf8b-5f8930311b28 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: d6138f3e-a927-4d61-890c-ccd60213e4f2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:24.620523 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-484a5500-48c2-4990-bf8b-5f8930311b28 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:24.621242 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-484a5500-48c2-4990-bf8b-5f8930311b28 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:24.621677 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-484a5500-48c2-4990-bf8b-5f8930311b28 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:24.622406 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-484a5500-48c2-4990-bf8b-5f8930311b28 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:24.622861 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-484a5500-48c2-4990-bf8b-5f8930311b28 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:24.623283 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-484a5500-48c2-4990-bf8b-5f8930311b28 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:24.625583 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-061bede7-7e81-406a-9237-a62d7ff2fd30 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:24.646631 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-061bede7-7e81-406a-9237-a62d7ff2fd30 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1369 microversion: 2.1 time: 0.211193 Sep 25 04:38:24.655642 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 167/387] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:24 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1369 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:38:24.838181 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-484a5500-48c2-4990-bf8b-5f8930311b28 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:24.846181 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-484a5500-48c2-4990-bf8b-5f8930311b28 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2" status: 200 len: 1452 microversion: 2.1 time: 0.237649 Sep 25 04:38:24.846747 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 221/388] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:24 2022] GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2 => generated 1452 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:25.670247 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-329f636f-85be-411f-b924-3117cc94d963 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:25.670797 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-329f636f-85be-411f-b924-3117cc94d963 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:25.677271 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-329f636f-85be-411f-b924-3117cc94d963 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:25.677751 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-329f636f-85be-411f-b924-3117cc94d963 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:25.678187 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-329f636f-85be-411f-b924-3117cc94d963 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:25.678871 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-329f636f-85be-411f-b924-3117cc94d963 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:25.679319 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-329f636f-85be-411f-b924-3117cc94d963 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:25.679738 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-329f636f-85be-411f-b924-3117cc94d963 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:25.813986 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-329f636f-85be-411f-b924-3117cc94d963 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:25.821735 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-329f636f-85be-411f-b924-3117cc94d963 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1369 microversion: 2.1 time: 0.155739 Sep 25 04:38:25.822352 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 168/389] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:25 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1369 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:26.633910 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-67b7b55c-c05b-44df-b317-37914dc3288c req-9fe7b595-15aa-4198-9f69-3f242a320fee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6138f3e-a927-4d61-890c-ccd60213e4f2", "tag": "9bd5cc76-3974-4656-ab0e-c104227f5d9c"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:38:26.645185 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-67b7b55c-c05b-44df-b317-37914dc3288c req-9fe7b595-15aa-4198-9f69-3f242a320fee service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:26.645671 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-67b7b55c-c05b-44df-b317-37914dc3288c req-9fe7b595-15aa-4198-9f69-3f242a320fee service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:26.646102 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-67b7b55c-c05b-44df-b317-37914dc3288c req-9fe7b595-15aa-4198-9f69-3f242a320fee service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:26.658933 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-67b7b55c-c05b-44df-b317-37914dc3288c req-9fe7b595-15aa-4198-9f69-3f242a320fee service nova] Creating event network-changed:9bd5cc76-3974-4656-ab0e-c104227f5d9c for instance d6138f3e-a927-4d61-890c-ccd60213e4f2 on hv-cinder-85535 Sep 25 04:38:26.663784 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-67b7b55c-c05b-44df-b317-37914dc3288c req-9fe7b595-15aa-4198-9f69-3f242a320fee service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033700 Sep 25 04:38:26.664383 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 222/390] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:38:26.846116 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-d8e632b6-6dc6-4ccd-8cd8-c9bc43deca42 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:26.846747 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-d8e632b6-6dc6-4ccd-8cd8-c9bc43deca42 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:26.853841 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d8e632b6-6dc6-4ccd-8cd8-c9bc43deca42 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:26.854345 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d8e632b6-6dc6-4ccd-8cd8-c9bc43deca42 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:26.854785 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d8e632b6-6dc6-4ccd-8cd8-c9bc43deca42 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:26.855687 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d8e632b6-6dc6-4ccd-8cd8-c9bc43deca42 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:26.856312 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d8e632b6-6dc6-4ccd-8cd8-c9bc43deca42 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:26.856765 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d8e632b6-6dc6-4ccd-8cd8-c9bc43deca42 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:27.017958 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-d8e632b6-6dc6-4ccd-8cd8-c9bc43deca42 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:27.026836 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-d8e632b6-6dc6-4ccd-8cd8-c9bc43deca42 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1369 microversion: 2.1 time: 0.184947 Sep 25 04:38:27.035607 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 169/391] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:26 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1369 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:28.051420 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-06784d4d-a72c-4b43-b590-8c3cca3fd68a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:28.052237 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-06784d4d-a72c-4b43-b590-8c3cca3fd68a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:28.060081 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-06784d4d-a72c-4b43-b590-8c3cca3fd68a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:28.060677 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-06784d4d-a72c-4b43-b590-8c3cca3fd68a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:28.061344 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-06784d4d-a72c-4b43-b590-8c3cca3fd68a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:28.062127 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-06784d4d-a72c-4b43-b590-8c3cca3fd68a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:28.062662 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-06784d4d-a72c-4b43-b590-8c3cca3fd68a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:28.063162 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-06784d4d-a72c-4b43-b590-8c3cca3fd68a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:28.241184 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-06784d4d-a72c-4b43-b590-8c3cca3fd68a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:28.255255 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-06784d4d-a72c-4b43-b590-8c3cca3fd68a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1369 microversion: 2.1 time: 0.208422 Sep 25 04:38:28.255939 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 223/392] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:28 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1369 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:29.282999 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-85c4b7b6-b64a-4cda-b206-96b7c3ca7ad7 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:29.284395 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-85c4b7b6-b64a-4cda-b206-96b7c3ca7ad7 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:29.287530 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_api:SELECT=58 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:38:29.310734 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-85c4b7b6-b64a-4cda-b206-96b7c3ca7ad7 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:29.310734 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-85c4b7b6-b64a-4cda-b206-96b7c3ca7ad7 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:29.310734 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-85c4b7b6-b64a-4cda-b206-96b7c3ca7ad7 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:29.310734 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-85c4b7b6-b64a-4cda-b206-96b7c3ca7ad7 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:29.311229 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-85c4b7b6-b64a-4cda-b206-96b7c3ca7ad7 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:29.311229 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-85c4b7b6-b64a-4cda-b206-96b7c3ca7ad7 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:29.614972 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-85c4b7b6-b64a-4cda-b206-96b7c3ca7ad7 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:29.625727 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-85c4b7b6-b64a-4cda-b206-96b7c3ca7ad7 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1369 microversion: 2.1 time: 0.345800 Sep 25 04:38:29.629499 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 170/393] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:29 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1369 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:30.653556 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-c3ee7aa6-de3d-4073-946f-61d62d360f8b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:30.654167 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-c3ee7aa6-de3d-4073-946f-61d62d360f8b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:30.656159 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell0:SELECT=2 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:38:30.656838 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell0:SELECT=10 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:38:30.657838 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=7 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:38:30.664451 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c3ee7aa6-de3d-4073-946f-61d62d360f8b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:30.664960 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c3ee7aa6-de3d-4073-946f-61d62d360f8b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:30.665405 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c3ee7aa6-de3d-4073-946f-61d62d360f8b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:30.666110 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c3ee7aa6-de3d-4073-946f-61d62d360f8b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:30.667134 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c3ee7aa6-de3d-4073-946f-61d62d360f8b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:30.667577 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c3ee7aa6-de3d-4073-946f-61d62d360f8b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:30.798527 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-c3ee7aa6-de3d-4073-946f-61d62d360f8b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:30.808033 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-c3ee7aa6-de3d-4073-946f-61d62d360f8b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1369 microversion: 2.1 time: 0.159003 Sep 25 04:38:30.808801 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 224/394] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:30 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1369 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:31.831502 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-bc1e0f77-2284-483c-8ede-b9aec2bc395d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:31.832046 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-bc1e0f77-2284-483c-8ede-b9aec2bc395d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:31.834136 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell0:SELECT=2 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:38:31.839741 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bc1e0f77-2284-483c-8ede-b9aec2bc395d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:31.840223 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bc1e0f77-2284-483c-8ede-b9aec2bc395d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:31.840669 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bc1e0f77-2284-483c-8ede-b9aec2bc395d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:31.841354 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bc1e0f77-2284-483c-8ede-b9aec2bc395d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:31.841802 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bc1e0f77-2284-483c-8ede-b9aec2bc395d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:31.842225 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bc1e0f77-2284-483c-8ede-b9aec2bc395d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:31.977709 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-bc1e0f77-2284-483c-8ede-b9aec2bc395d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:31.986009 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-bc1e0f77-2284-483c-8ede-b9aec2bc395d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1369 microversion: 2.1 time: 0.158477 Sep 25 04:38:31.986569 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 171/395] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:31 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1369 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:32.139744 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-29a9f140-08a7-4ea4-b24b-0bd2b7309509 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1219557529", "imageRef": "e5cfdbb2-d0ce-4736-b311-1a3c155844e9", "flavorRef": "452"}} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:38:32.196326 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.network.neutron [None req-29a9f140-08a7-4ea4-b24b-0bd2b7309509 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] validate_networks() for None {{(pid=127142) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 04:38:32.474485 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-29a9f140-08a7-4ea4-b24b-0bd2b7309509 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Flavor limits 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 04:38:32.474904 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-29a9f140-08a7-4ea4-b24b-0bd2b7309509 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Image limits 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 04:38:32.475397 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-29a9f140-08a7-4ea4-b24b-0bd2b7309509 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Flavor pref 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 04:38:32.475828 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-29a9f140-08a7-4ea4-b24b-0bd2b7309509 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Image pref 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 04:38:32.476228 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-29a9f140-08a7-4ea4-b24b-0bd2b7309509 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 04:38:32.485045 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-29a9f140-08a7-4ea4-b24b-0bd2b7309509 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:32.485528 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-29a9f140-08a7-4ea4-b24b-0bd2b7309509 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:32.485957 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-29a9f140-08a7-4ea4-b24b-0bd2b7309509 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:32.486669 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-29a9f140-08a7-4ea4-b24b-0bd2b7309509 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:32.487112 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-29a9f140-08a7-4ea4-b24b-0bd2b7309509 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:32.487527 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-29a9f140-08a7-4ea4-b24b-0bd2b7309509 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:32.503922 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.quota [None req-29a9f140-08a7-4ea4-b24b-0bd2b7309509 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Getting quotas for project b7d504f39d52488abf8282bc0ec2786c. Resources: {'instances', 'ram', 'cores'} {{(pid=127142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 04:38:32.507766 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.quota [None req-29a9f140-08a7-4ea4-b24b-0bd2b7309509 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Getting quotas for user 10fac643eaad4a29913b3090c8931d54 and project b7d504f39d52488abf8282bc0ec2786c. Resources: {'instances', 'ram', 'cores'} {{(pid=127142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 04:38:32.519317 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-29a9f140-08a7-4ea4-b24b-0bd2b7309509 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Going to run 1 instances... {{(pid=127142) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 04:38:32.521589 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-29a9f140-08a7-4ea4-b24b-0bd2b7309509 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] [instance: 699c1287-b1cd-4872-911c-11a44f8b6a0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5cfdbb2-d0ce-4736-b311-1a3c155844e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 04:38:32.566545 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-29a9f140-08a7-4ea4-b24b-0bd2b7309509 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.430535 Sep 25 04:38:32.567178 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 225/396] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 25 04:38:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 432 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 04:38:32.578965 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-a449db6e-28f7-4818-9c20-af4b51a7c39f tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:32.579611 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-a449db6e-28f7-4818-9c20-af4b51a7c39f tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] [instance: 699c1287-b1cd-4872-911c-11a44f8b6a0e] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:32.633833 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-a449db6e-28f7-4818-9c20-af4b51a7c39f tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fac643eaad4a29913b3090c8931d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d504f39d52488abf8282bc0ec2786c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:32.641861 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-a449db6e-28f7-4818-9c20-af4b51a7c39f tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] 10.222.0.25 "GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e" status: 200 len: 1215 microversion: 2.1 time: 0.066689 Sep 25 04:38:32.642610 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 172/397] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:32 2022] GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e => generated 1215 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:33.008871 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-35ff9fc8-4b39-4abc-937e-3cb5a282d40a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:33.009486 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-35ff9fc8-4b39-4abc-937e-3cb5a282d40a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:33.017441 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-35ff9fc8-4b39-4abc-937e-3cb5a282d40a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:33.018064 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-35ff9fc8-4b39-4abc-937e-3cb5a282d40a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:33.018443 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-35ff9fc8-4b39-4abc-937e-3cb5a282d40a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:33.019185 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-35ff9fc8-4b39-4abc-937e-3cb5a282d40a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:33.019638 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-35ff9fc8-4b39-4abc-937e-3cb5a282d40a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:33.020111 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-35ff9fc8-4b39-4abc-937e-3cb5a282d40a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:33.154705 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-35ff9fc8-4b39-4abc-937e-3cb5a282d40a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:33.162471 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-35ff9fc8-4b39-4abc-937e-3cb5a282d40a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1369 microversion: 2.1 time: 0.157630 Sep 25 04:38:33.163177 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 226/398] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:33 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1369 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:33.497943 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [req-015aece3-4d21-414f-8ca4-95ff5f7be82e req-e11571e1-698d-4411-9330-c4d2590c3e09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1348d173-f0db-4d60-94f5-1765387d7294", "name": "network-vif-plugged", "status": "completed", "tag": "200b52b7-c7da-4e8b-924a-5151390b5778"}]} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:38:33.510109 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-015aece3-4d21-414f-8ca4-95ff5f7be82e req-e11571e1-698d-4411-9330-c4d2590c3e09 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:33.512347 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-015aece3-4d21-414f-8ca4-95ff5f7be82e req-e11571e1-698d-4411-9330-c4d2590c3e09 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:33.512828 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-015aece3-4d21-414f-8ca4-95ff5f7be82e req-e11571e1-698d-4411-9330-c4d2590c3e09 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:33.526260 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.compute.server_external_events [req-015aece3-4d21-414f-8ca4-95ff5f7be82e req-e11571e1-698d-4411-9330-c4d2590c3e09 service nova] Creating event network-vif-plugged:200b52b7-c7da-4e8b-924a-5151390b5778 for instance 1348d173-f0db-4d60-94f5-1765387d7294 on hv-cinder-85535 Sep 25 04:38:33.531565 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [req-015aece3-4d21-414f-8ca4-95ff5f7be82e req-e11571e1-698d-4411-9330-c4d2590c3e09 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037895 Sep 25 04:38:33.532690 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 173/399] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:38:33.665794 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-37830e4a-1704-424c-bb33-13da1b3622e8 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:33.666535 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-37830e4a-1704-424c-bb33-13da1b3622e8 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] [instance: 699c1287-b1cd-4872-911c-11a44f8b6a0e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:33.672459 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-37830e4a-1704-424c-bb33-13da1b3622e8 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:33.672971 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-37830e4a-1704-424c-bb33-13da1b3622e8 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:33.673406 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-37830e4a-1704-424c-bb33-13da1b3622e8 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:33.674090 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-37830e4a-1704-424c-bb33-13da1b3622e8 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:33.674541 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-37830e4a-1704-424c-bb33-13da1b3622e8 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:33.674965 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-37830e4a-1704-424c-bb33-13da1b3622e8 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:33.740452 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-37830e4a-1704-424c-bb33-13da1b3622e8 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fac643eaad4a29913b3090c8931d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d504f39d52488abf8282bc0ec2786c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:33.749163 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-37830e4a-1704-424c-bb33-13da1b3622e8 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] 10.222.0.25 "GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e" status: 200 len: 1267 microversion: 2.1 time: 0.087213 Sep 25 04:38:33.749808 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 227/400] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:33 2022] GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e => generated 1267 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:34.186784 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-52dacf53-69ce-463d-be6c-6ea16abf721c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:34.187541 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-52dacf53-69ce-463d-be6c-6ea16abf721c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:34.195419 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-52dacf53-69ce-463d-be6c-6ea16abf721c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:34.196201 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-52dacf53-69ce-463d-be6c-6ea16abf721c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:34.198346 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-52dacf53-69ce-463d-be6c-6ea16abf721c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:34.199293 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-52dacf53-69ce-463d-be6c-6ea16abf721c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:34.199929 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-52dacf53-69ce-463d-be6c-6ea16abf721c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:34.200528 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-52dacf53-69ce-463d-be6c-6ea16abf721c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:34.348932 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-52dacf53-69ce-463d-be6c-6ea16abf721c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:34.358145 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-52dacf53-69ce-463d-be6c-6ea16abf721c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1369 microversion: 2.1 time: 0.175751 Sep 25 04:38:34.358712 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 174/401] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:34 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1369 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:34.772560 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-fbc75e6d-5c6f-4b0b-9dad-ce504f24c1c1 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:34.773210 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-fbc75e6d-5c6f-4b0b-9dad-ce504f24c1c1 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] [instance: 699c1287-b1cd-4872-911c-11a44f8b6a0e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:34.780166 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fbc75e6d-5c6f-4b0b-9dad-ce504f24c1c1 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:34.780693 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fbc75e6d-5c6f-4b0b-9dad-ce504f24c1c1 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:34.781140 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fbc75e6d-5c6f-4b0b-9dad-ce504f24c1c1 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:34.781862 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fbc75e6d-5c6f-4b0b-9dad-ce504f24c1c1 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:34.782544 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fbc75e6d-5c6f-4b0b-9dad-ce504f24c1c1 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:34.782968 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fbc75e6d-5c6f-4b0b-9dad-ce504f24c1c1 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:34.846404 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-fbc75e6d-5c6f-4b0b-9dad-ce504f24c1c1 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fac643eaad4a29913b3090c8931d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d504f39d52488abf8282bc0ec2786c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:34.854481 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-fbc75e6d-5c6f-4b0b-9dad-ce504f24c1c1 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] 10.222.0.25 "GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e" status: 200 len: 1273 microversion: 2.1 time: 0.085808 Sep 25 04:38:34.855041 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 228/402] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:34 2022] GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e => generated 1273 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:35.380807 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-5f261103-6469-4fd6-b9bd-ec7c72ff1660 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:35.381432 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-5f261103-6469-4fd6-b9bd-ec7c72ff1660 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:35.388778 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5f261103-6469-4fd6-b9bd-ec7c72ff1660 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:35.389288 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5f261103-6469-4fd6-b9bd-ec7c72ff1660 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:35.389732 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5f261103-6469-4fd6-b9bd-ec7c72ff1660 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:35.390461 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5f261103-6469-4fd6-b9bd-ec7c72ff1660 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:35.390927 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5f261103-6469-4fd6-b9bd-ec7c72ff1660 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:35.391361 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5f261103-6469-4fd6-b9bd-ec7c72ff1660 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:35.563400 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-5f261103-6469-4fd6-b9bd-ec7c72ff1660 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:35.574356 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-5f261103-6469-4fd6-b9bd-ec7c72ff1660 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1369 microversion: 2.1 time: 0.197402 Sep 25 04:38:35.575057 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 175/403] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:35 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1369 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:35.883285 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-edf930d9-29dc-43ba-8e93-ab733f343ac4 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:35.884245 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-edf930d9-29dc-43ba-8e93-ab733f343ac4 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] [instance: 699c1287-b1cd-4872-911c-11a44f8b6a0e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:35.891261 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-edf930d9-29dc-43ba-8e93-ab733f343ac4 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:35.891973 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-edf930d9-29dc-43ba-8e93-ab733f343ac4 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:35.892572 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-edf930d9-29dc-43ba-8e93-ab733f343ac4 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:35.894395 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-edf930d9-29dc-43ba-8e93-ab733f343ac4 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:35.894871 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-edf930d9-29dc-43ba-8e93-ab733f343ac4 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:35.895315 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-edf930d9-29dc-43ba-8e93-ab733f343ac4 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:36.152791 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-edf930d9-29dc-43ba-8e93-ab733f343ac4 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fac643eaad4a29913b3090c8931d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d504f39d52488abf8282bc0ec2786c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:36.162332 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-edf930d9-29dc-43ba-8e93-ab733f343ac4 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] 10.222.0.25 "GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e" status: 200 len: 1315 microversion: 2.1 time: 0.285720 Sep 25 04:38:36.162984 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 229/404] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:35 2022] GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:36.597677 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-6471b88f-d92b-4fab-b1ab-4e3015146f3e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:36.598276 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-6471b88f-d92b-4fab-b1ab-4e3015146f3e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:36.606057 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6471b88f-d92b-4fab-b1ab-4e3015146f3e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:36.606726 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6471b88f-d92b-4fab-b1ab-4e3015146f3e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:36.607170 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6471b88f-d92b-4fab-b1ab-4e3015146f3e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:36.607879 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6471b88f-d92b-4fab-b1ab-4e3015146f3e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:36.608344 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6471b88f-d92b-4fab-b1ab-4e3015146f3e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:36.608840 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6471b88f-d92b-4fab-b1ab-4e3015146f3e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:36.841466 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-fc4b021f-0c5c-450b-8e0f-3ab0a59861db req-cd5c04df-3c8a-4aeb-a16b-09fc7e0f3266 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "699c1287-b1cd-4872-911c-11a44f8b6a0e", "tag": "f37d4706-1585-4270-94bf-7edaf49afe4a"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:38:36.851033 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-fc4b021f-0c5c-450b-8e0f-3ab0a59861db req-cd5c04df-3c8a-4aeb-a16b-09fc7e0f3266 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:36.851515 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-fc4b021f-0c5c-450b-8e0f-3ab0a59861db req-cd5c04df-3c8a-4aeb-a16b-09fc7e0f3266 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:36.852530 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-fc4b021f-0c5c-450b-8e0f-3ab0a59861db req-cd5c04df-3c8a-4aeb-a16b-09fc7e0f3266 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:36.864240 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-fc4b021f-0c5c-450b-8e0f-3ab0a59861db req-cd5c04df-3c8a-4aeb-a16b-09fc7e0f3266 service nova] Creating event network-changed:f37d4706-1585-4270-94bf-7edaf49afe4a for instance 699c1287-b1cd-4872-911c-11a44f8b6a0e on hv-cinder-85535 Sep 25 04:38:36.869116 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-fc4b021f-0c5c-450b-8e0f-3ab0a59861db req-cd5c04df-3c8a-4aeb-a16b-09fc7e0f3266 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031404 Sep 25 04:38:36.870621 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 230/405] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 04:38:36.904167 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-6471b88f-d92b-4fab-b1ab-4e3015146f3e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:36.912113 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-6471b88f-d92b-4fab-b1ab-4e3015146f3e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1563 microversion: 2.1 time: 0.318315 Sep 25 04:38:36.912709 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 176/406] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:36 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1563 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:36.936442 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-2ca30bb5-83d5-4f04-8a8c-51d405a7b5e0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:36.937643 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-2ca30bb5-83d5-4f04-8a8c-51d405a7b5e0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:36.943794 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2ca30bb5-83d5-4f04-8a8c-51d405a7b5e0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:36.944272 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2ca30bb5-83d5-4f04-8a8c-51d405a7b5e0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:36.944927 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2ca30bb5-83d5-4f04-8a8c-51d405a7b5e0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:36.946121 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2ca30bb5-83d5-4f04-8a8c-51d405a7b5e0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:36.946805 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2ca30bb5-83d5-4f04-8a8c-51d405a7b5e0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:36.947242 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2ca30bb5-83d5-4f04-8a8c-51d405a7b5e0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:37.072337 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-2ca30bb5-83d5-4f04-8a8c-51d405a7b5e0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.140679 Sep 25 04:38:37.073269 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 231/407] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Sep 25 04:38:36 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294/os-interface => generated 284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:38:37.185822 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-23eba051-d779-4032-8909-b68e22a531e2 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:37.186677 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-23eba051-d779-4032-8909-b68e22a531e2 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] [instance: 699c1287-b1cd-4872-911c-11a44f8b6a0e] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:37.193291 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-23eba051-d779-4032-8909-b68e22a531e2 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:37.194011 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-23eba051-d779-4032-8909-b68e22a531e2 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:37.194435 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-23eba051-d779-4032-8909-b68e22a531e2 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:37.195306 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-23eba051-d779-4032-8909-b68e22a531e2 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:37.195910 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-23eba051-d779-4032-8909-b68e22a531e2 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:37.196488 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-23eba051-d779-4032-8909-b68e22a531e2 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:37.372894 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-23eba051-d779-4032-8909-b68e22a531e2 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fac643eaad4a29913b3090c8931d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d504f39d52488abf8282bc0ec2786c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:37.381468 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-23eba051-d779-4032-8909-b68e22a531e2 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] 10.222.0.25 "GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e" status: 200 len: 1315 microversion: 2.1 time: 0.199485 Sep 25 04:38:37.382165 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 177/408] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:37 2022] GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:38.257131 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-3132a0a9-c0b1-4d5a-8142-fcea791fe13a req-115e3d32-ad72-4912-bdd3-fb60e32e18aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1348d173-f0db-4d60-94f5-1765387d7294", "tag": "200b52b7-c7da-4e8b-924a-5151390b5778"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:38:38.267759 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-3132a0a9-c0b1-4d5a-8142-fcea791fe13a req-115e3d32-ad72-4912-bdd3-fb60e32e18aa service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:38.268303 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-3132a0a9-c0b1-4d5a-8142-fcea791fe13a req-115e3d32-ad72-4912-bdd3-fb60e32e18aa service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:38.268828 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-3132a0a9-c0b1-4d5a-8142-fcea791fe13a req-115e3d32-ad72-4912-bdd3-fb60e32e18aa service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:38.280560 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-3132a0a9-c0b1-4d5a-8142-fcea791fe13a req-115e3d32-ad72-4912-bdd3-fb60e32e18aa service nova] Creating event network-changed:200b52b7-c7da-4e8b-924a-5151390b5778 for instance 1348d173-f0db-4d60-94f5-1765387d7294 on hv-cinder-85535 Sep 25 04:38:38.285681 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-3132a0a9-c0b1-4d5a-8142-fcea791fe13a req-115e3d32-ad72-4912-bdd3-fb60e32e18aa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032225 Sep 25 04:38:38.286269 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 232/409] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:38:38.405505 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-e7863d68-6af0-4de8-b5cf-2d932ab3f19c tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:38.406325 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-e7863d68-6af0-4de8-b5cf-2d932ab3f19c tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] [instance: 699c1287-b1cd-4872-911c-11a44f8b6a0e] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:38.413116 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e7863d68-6af0-4de8-b5cf-2d932ab3f19c tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:38.413611 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e7863d68-6af0-4de8-b5cf-2d932ab3f19c tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:38.414098 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e7863d68-6af0-4de8-b5cf-2d932ab3f19c tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:38.414799 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e7863d68-6af0-4de8-b5cf-2d932ab3f19c tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:38.415257 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e7863d68-6af0-4de8-b5cf-2d932ab3f19c tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:38.415683 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e7863d68-6af0-4de8-b5cf-2d932ab3f19c tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:38.558793 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-e7863d68-6af0-4de8-b5cf-2d932ab3f19c tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fac643eaad4a29913b3090c8931d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d504f39d52488abf8282bc0ec2786c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:38.566953 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-e7863d68-6af0-4de8-b5cf-2d932ab3f19c tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] 10.222.0.25 "GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e" status: 200 len: 1315 microversion: 2.1 time: 0.165286 Sep 25 04:38:38.567512 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 178/410] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:38 2022] GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:39.590669 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-07a9cc8d-e30e-48b8-86c4-16ce5b71a26a tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:39.591390 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-07a9cc8d-e30e-48b8-86c4-16ce5b71a26a tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] [instance: 699c1287-b1cd-4872-911c-11a44f8b6a0e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:39.597590 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-07a9cc8d-e30e-48b8-86c4-16ce5b71a26a tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:39.598087 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-07a9cc8d-e30e-48b8-86c4-16ce5b71a26a tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:39.598907 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-07a9cc8d-e30e-48b8-86c4-16ce5b71a26a tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:39.599807 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-07a9cc8d-e30e-48b8-86c4-16ce5b71a26a tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:39.600393 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-07a9cc8d-e30e-48b8-86c4-16ce5b71a26a tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:39.601116 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-07a9cc8d-e30e-48b8-86c4-16ce5b71a26a tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:39.792719 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-07a9cc8d-e30e-48b8-86c4-16ce5b71a26a tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fac643eaad4a29913b3090c8931d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d504f39d52488abf8282bc0ec2786c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:39.802118 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-07a9cc8d-e30e-48b8-86c4-16ce5b71a26a tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] 10.222.0.25 "GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e" status: 200 len: 1315 microversion: 2.1 time: 0.215825 Sep 25 04:38:39.802702 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 233/411] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:39 2022] GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:40.827538 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-d197e401-1978-4c4f-ad0e-c9304f4a791b tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:40.828136 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-d197e401-1978-4c4f-ad0e-c9304f4a791b tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] [instance: 699c1287-b1cd-4872-911c-11a44f8b6a0e] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:40.835455 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d197e401-1978-4c4f-ad0e-c9304f4a791b tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:40.835951 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d197e401-1978-4c4f-ad0e-c9304f4a791b tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:40.836430 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d197e401-1978-4c4f-ad0e-c9304f4a791b tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:40.837197 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d197e401-1978-4c4f-ad0e-c9304f4a791b tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:40.837839 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d197e401-1978-4c4f-ad0e-c9304f4a791b tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:40.838942 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d197e401-1978-4c4f-ad0e-c9304f4a791b tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:41.049274 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-d197e401-1978-4c4f-ad0e-c9304f4a791b tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fac643eaad4a29913b3090c8931d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d504f39d52488abf8282bc0ec2786c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:41.058027 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-d197e401-1978-4c4f-ad0e-c9304f4a791b tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] 10.222.0.25 "GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e" status: 200 len: 1315 microversion: 2.1 time: 0.235008 Sep 25 04:38:41.058877 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 179/412] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:40 2022] GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:42.085545 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-cb28c9f3-3ad8-4b52-aea6-159abc9a4885 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:42.087319 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-cb28c9f3-3ad8-4b52-aea6-159abc9a4885 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] [instance: 699c1287-b1cd-4872-911c-11a44f8b6a0e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:42.096359 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cb28c9f3-3ad8-4b52-aea6-159abc9a4885 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:42.097265 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cb28c9f3-3ad8-4b52-aea6-159abc9a4885 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:42.097781 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cb28c9f3-3ad8-4b52-aea6-159abc9a4885 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:42.098580 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cb28c9f3-3ad8-4b52-aea6-159abc9a4885 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:42.099110 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cb28c9f3-3ad8-4b52-aea6-159abc9a4885 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:42.099603 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cb28c9f3-3ad8-4b52-aea6-159abc9a4885 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:42.290223 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-cb28c9f3-3ad8-4b52-aea6-159abc9a4885 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fac643eaad4a29913b3090c8931d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d504f39d52488abf8282bc0ec2786c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:42.299988 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-cb28c9f3-3ad8-4b52-aea6-159abc9a4885 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] 10.222.0.25 "GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e" status: 200 len: 1315 microversion: 2.1 time: 0.219492 Sep 25 04:38:42.300579 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 234/413] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:42 2022] GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:38:43.323692 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-85f46c06-7436-46f3-b0a0-e8c9a1abfe4f tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:43.324783 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-85f46c06-7436-46f3-b0a0-e8c9a1abfe4f tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] [instance: 699c1287-b1cd-4872-911c-11a44f8b6a0e] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:43.330193 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell0:SELECT=2 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:38:43.335225 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-85f46c06-7436-46f3-b0a0-e8c9a1abfe4f tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:43.335852 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-85f46c06-7436-46f3-b0a0-e8c9a1abfe4f tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:43.336397 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-85f46c06-7436-46f3-b0a0-e8c9a1abfe4f tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:43.337368 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-85f46c06-7436-46f3-b0a0-e8c9a1abfe4f tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:43.338992 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-85f46c06-7436-46f3-b0a0-e8c9a1abfe4f tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:43.339444 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-85f46c06-7436-46f3-b0a0-e8c9a1abfe4f tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:43.582348 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-85f46c06-7436-46f3-b0a0-e8c9a1abfe4f tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fac643eaad4a29913b3090c8931d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d504f39d52488abf8282bc0ec2786c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:43.591217 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-85f46c06-7436-46f3-b0a0-e8c9a1abfe4f tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] 10.222.0.25 "GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e" status: 200 len: 1315 microversion: 2.1 time: 0.271716 Sep 25 04:38:43.591931 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 180/414] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:43 2022] GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:44.615572 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-06ca579b-f26c-4677-9796-4860a5a730a8 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:44.616895 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-06ca579b-f26c-4677-9796-4860a5a730a8 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] [instance: 699c1287-b1cd-4872-911c-11a44f8b6a0e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:44.618906 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell0:SELECT=2 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:38:44.619583 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell0:SELECT=6 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:38:44.625633 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-06ca579b-f26c-4677-9796-4860a5a730a8 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:44.626123 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-06ca579b-f26c-4677-9796-4860a5a730a8 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:44.627215 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-06ca579b-f26c-4677-9796-4860a5a730a8 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:44.628284 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-06ca579b-f26c-4677-9796-4860a5a730a8 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:44.629074 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-06ca579b-f26c-4677-9796-4860a5a730a8 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:44.629795 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-06ca579b-f26c-4677-9796-4860a5a730a8 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:45.118403 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-06ca579b-f26c-4677-9796-4860a5a730a8 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fac643eaad4a29913b3090c8931d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d504f39d52488abf8282bc0ec2786c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:45.127931 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-06ca579b-f26c-4677-9796-4860a5a730a8 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] 10.222.0.25 "GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e" status: 200 len: 1315 microversion: 2.1 time: 0.516179 Sep 25 04:38:45.129157 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 235/415] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:44 2022] GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e => generated 1315 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:46.152925 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-9a907ba5-c85b-460f-9080-758233bf4267 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:46.153508 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-9a907ba5-c85b-460f-9080-758233bf4267 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] [instance: 699c1287-b1cd-4872-911c-11a44f8b6a0e] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:46.162606 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9a907ba5-c85b-460f-9080-758233bf4267 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:46.163175 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9a907ba5-c85b-460f-9080-758233bf4267 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:46.163824 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9a907ba5-c85b-460f-9080-758233bf4267 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:46.164809 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9a907ba5-c85b-460f-9080-758233bf4267 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:46.165512 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9a907ba5-c85b-460f-9080-758233bf4267 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:46.166219 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9a907ba5-c85b-460f-9080-758233bf4267 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:46.172172 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=100 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:38:46.330600 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-9a907ba5-c85b-460f-9080-758233bf4267 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fac643eaad4a29913b3090c8931d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d504f39d52488abf8282bc0ec2786c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:46.339774 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-9a907ba5-c85b-460f-9080-758233bf4267 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] 10.222.0.25 "GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e" status: 200 len: 1315 microversion: 2.1 time: 0.191955 Sep 25 04:38:46.340353 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 181/416] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:46 2022] GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:47.366727 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-1fc822c2-9e92-404e-a206-ad8d5bad2313 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:47.368936 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-1fc822c2-9e92-404e-a206-ad8d5bad2313 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] [instance: 699c1287-b1cd-4872-911c-11a44f8b6a0e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:47.378639 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1fc822c2-9e92-404e-a206-ad8d5bad2313 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:47.380234 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1fc822c2-9e92-404e-a206-ad8d5bad2313 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:47.381486 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1fc822c2-9e92-404e-a206-ad8d5bad2313 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:47.382471 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1fc822c2-9e92-404e-a206-ad8d5bad2313 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:47.383151 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1fc822c2-9e92-404e-a206-ad8d5bad2313 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:47.383807 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1fc822c2-9e92-404e-a206-ad8d5bad2313 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:47.734534 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-1fc822c2-9e92-404e-a206-ad8d5bad2313 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fac643eaad4a29913b3090c8931d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d504f39d52488abf8282bc0ec2786c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:47.746410 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-1fc822c2-9e92-404e-a206-ad8d5bad2313 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] 10.222.0.25 "GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e" status: 200 len: 1315 microversion: 2.1 time: 0.384275 Sep 25 04:38:47.748043 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 236/417] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:47 2022] GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e => generated 1315 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:47.779828 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [req-e34ec5fe-7597-406d-b1bf-5dfd3b5ee19e req-0f94f0b3-6702-4a0b-804e-24f35b46f930 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "699c1287-b1cd-4872-911c-11a44f8b6a0e", "name": "network-vif-plugged", "status": "completed", "tag": "f37d4706-1585-4270-94bf-7edaf49afe4a"}]} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:38:47.805462 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-e34ec5fe-7597-406d-b1bf-5dfd3b5ee19e req-0f94f0b3-6702-4a0b-804e-24f35b46f930 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:47.808740 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-e34ec5fe-7597-406d-b1bf-5dfd3b5ee19e req-0f94f0b3-6702-4a0b-804e-24f35b46f930 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:47.809261 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-e34ec5fe-7597-406d-b1bf-5dfd3b5ee19e req-0f94f0b3-6702-4a0b-804e-24f35b46f930 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:47.821974 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.compute.server_external_events [req-e34ec5fe-7597-406d-b1bf-5dfd3b5ee19e req-0f94f0b3-6702-4a0b-804e-24f35b46f930 service nova] Creating event network-vif-plugged:f37d4706-1585-4270-94bf-7edaf49afe4a for instance 699c1287-b1cd-4872-911c-11a44f8b6a0e on hv-cinder-85535 Sep 25 04:38:47.836959 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [req-e34ec5fe-7597-406d-b1bf-5dfd3b5ee19e req-0f94f0b3-6702-4a0b-804e-24f35b46f930 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067814 Sep 25 04:38:47.837926 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 182/418] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:38:48.771261 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-3f9cfb69-42d6-4dac-ae20-23227bb315a3 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:48.771851 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-3f9cfb69-42d6-4dac-ae20-23227bb315a3 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] [instance: 699c1287-b1cd-4872-911c-11a44f8b6a0e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:48.782578 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3f9cfb69-42d6-4dac-ae20-23227bb315a3 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:48.783082 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3f9cfb69-42d6-4dac-ae20-23227bb315a3 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:48.783517 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3f9cfb69-42d6-4dac-ae20-23227bb315a3 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:48.784223 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3f9cfb69-42d6-4dac-ae20-23227bb315a3 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:48.784698 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3f9cfb69-42d6-4dac-ae20-23227bb315a3 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:48.785125 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3f9cfb69-42d6-4dac-ae20-23227bb315a3 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:49.074768 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-3f9cfb69-42d6-4dac-ae20-23227bb315a3 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fac643eaad4a29913b3090c8931d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d504f39d52488abf8282bc0ec2786c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:49.084629 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-3f9cfb69-42d6-4dac-ae20-23227bb315a3 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] 10.222.0.25 "GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e" status: 200 len: 1315 microversion: 2.1 time: 0.316706 Sep 25 04:38:49.085850 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 237/419] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:48 2022] GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:50.108690 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-1f8050c8-8755-44a6-b2c0-c771156dce3d tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:50.109992 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-1f8050c8-8755-44a6-b2c0-c771156dce3d tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] [instance: 699c1287-b1cd-4872-911c-11a44f8b6a0e] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:50.124049 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1f8050c8-8755-44a6-b2c0-c771156dce3d tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:50.124674 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1f8050c8-8755-44a6-b2c0-c771156dce3d tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:50.125121 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1f8050c8-8755-44a6-b2c0-c771156dce3d tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:50.125848 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1f8050c8-8755-44a6-b2c0-c771156dce3d tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:50.126305 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1f8050c8-8755-44a6-b2c0-c771156dce3d tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:50.130375 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1f8050c8-8755-44a6-b2c0-c771156dce3d tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:50.392504 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-1f8050c8-8755-44a6-b2c0-c771156dce3d tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fac643eaad4a29913b3090c8931d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d504f39d52488abf8282bc0ec2786c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:50.401588 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-1f8050c8-8755-44a6-b2c0-c771156dce3d tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] 10.222.0.25 "GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e" status: 200 len: 1315 microversion: 2.1 time: 0.297670 Sep 25 04:38:50.403147 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 183/420] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:50 2022] GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:51.425702 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-4c88e888-d08b-423c-ac3b-6dcc3a5822aa tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:51.426564 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-4c88e888-d08b-423c-ac3b-6dcc3a5822aa tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] [instance: 699c1287-b1cd-4872-911c-11a44f8b6a0e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:51.433993 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4c88e888-d08b-423c-ac3b-6dcc3a5822aa tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:51.435093 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4c88e888-d08b-423c-ac3b-6dcc3a5822aa tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:51.435525 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4c88e888-d08b-423c-ac3b-6dcc3a5822aa tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:51.436231 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4c88e888-d08b-423c-ac3b-6dcc3a5822aa tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:51.436804 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4c88e888-d08b-423c-ac3b-6dcc3a5822aa tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:51.437402 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4c88e888-d08b-423c-ac3b-6dcc3a5822aa tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:51.633003 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-4c88e888-d08b-423c-ac3b-6dcc3a5822aa tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fac643eaad4a29913b3090c8931d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d504f39d52488abf8282bc0ec2786c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:51.641918 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-4c88e888-d08b-423c-ac3b-6dcc3a5822aa tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] 10.222.0.25 "GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e" status: 200 len: 1465 microversion: 2.1 time: 0.221341 Sep 25 04:38:51.657517 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 238/421] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:51 2022] GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e => generated 1465 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:51.696030 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-a8c09dc1-e7d5-4a86-a166-d7f07d3c0a7b tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:51.697234 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-a8c09dc1-e7d5-4a86-a166-d7f07d3c0a7b tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] [instance: 699c1287-b1cd-4872-911c-11a44f8b6a0e] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:51.704935 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a8c09dc1-e7d5-4a86-a166-d7f07d3c0a7b tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:51.705717 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a8c09dc1-e7d5-4a86-a166-d7f07d3c0a7b tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:51.706355 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a8c09dc1-e7d5-4a86-a166-d7f07d3c0a7b tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:51.707237 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a8c09dc1-e7d5-4a86-a166-d7f07d3c0a7b tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:51.707694 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a8c09dc1-e7d5-4a86-a166-d7f07d3c0a7b tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:51.708318 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a8c09dc1-e7d5-4a86-a166-d7f07d3c0a7b tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:51.745017 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-a8c09dc1-e7d5-4a86-a166-d7f07d3c0a7b tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] [instance: 699c1287-b1cd-4872-911c-11a44f8b6a0e] Going to try to terminate instance {{(pid=127141) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 04:38:51.859378 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-a8c09dc1-e7d5-4a86-a166-d7f07d3c0a7b tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] 10.222.0.25 "DELETE /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e" status: 204 len: 0 microversion: 2.1 time: 0.166877 Sep 25 04:38:51.860176 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 184/422] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 25 04:38:51 2022] DELETE /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 04:38:51.868432 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-afe5430e-f78f-49ee-8004-ffc8259ea1f0 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:51.869114 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-afe5430e-f78f-49ee-8004-ffc8259ea1f0 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] [instance: 699c1287-b1cd-4872-911c-11a44f8b6a0e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:51.879578 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-afe5430e-f78f-49ee-8004-ffc8259ea1f0 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:51.880728 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-afe5430e-f78f-49ee-8004-ffc8259ea1f0 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:51.881449 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-afe5430e-f78f-49ee-8004-ffc8259ea1f0 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:51.882480 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-afe5430e-f78f-49ee-8004-ffc8259ea1f0 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:51.883270 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-afe5430e-f78f-49ee-8004-ffc8259ea1f0 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:51.884014 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-afe5430e-f78f-49ee-8004-ffc8259ea1f0 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:51.910720 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=100 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:38:52.062842 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-afe5430e-f78f-49ee-8004-ffc8259ea1f0 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fac643eaad4a29913b3090c8931d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d504f39d52488abf8282bc0ec2786c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:52.071835 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-afe5430e-f78f-49ee-8004-ffc8259ea1f0 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] 10.222.0.25 "GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e" status: 200 len: 1471 microversion: 2.1 time: 0.207337 Sep 25 04:38:52.072776 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 239/423] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:51 2022] GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e => generated 1471 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:53.095528 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-c7788337-4ca7-404d-86fd-dfb19fa0067d tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:53.096461 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-c7788337-4ca7-404d-86fd-dfb19fa0067d tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] [instance: 699c1287-b1cd-4872-911c-11a44f8b6a0e] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:53.106233 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c7788337-4ca7-404d-86fd-dfb19fa0067d tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:53.108908 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c7788337-4ca7-404d-86fd-dfb19fa0067d tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:53.109448 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c7788337-4ca7-404d-86fd-dfb19fa0067d tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:53.113563 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c7788337-4ca7-404d-86fd-dfb19fa0067d tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:53.114233 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c7788337-4ca7-404d-86fd-dfb19fa0067d tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:53.114994 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c7788337-4ca7-404d-86fd-dfb19fa0067d tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:53.288385 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-c7788337-4ca7-404d-86fd-dfb19fa0067d tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fac643eaad4a29913b3090c8931d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d504f39d52488abf8282bc0ec2786c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:53.299262 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-c7788337-4ca7-404d-86fd-dfb19fa0067d tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] 10.222.0.25 "GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e" status: 200 len: 1471 microversion: 2.1 time: 0.207973 Sep 25 04:38:53.299839 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 185/424] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:53 2022] GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e => generated 1471 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:54.342067 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-8029828e-01e3-4dfd-8efa-81137ab8186c tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:54.343687 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-8029828e-01e3-4dfd-8efa-81137ab8186c tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] [instance: 699c1287-b1cd-4872-911c-11a44f8b6a0e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:54.351402 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8029828e-01e3-4dfd-8efa-81137ab8186c tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:54.367274 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8029828e-01e3-4dfd-8efa-81137ab8186c tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:54.367274 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8029828e-01e3-4dfd-8efa-81137ab8186c tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:54.367274 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8029828e-01e3-4dfd-8efa-81137ab8186c tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:54.367274 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8029828e-01e3-4dfd-8efa-81137ab8186c tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:54.367846 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8029828e-01e3-4dfd-8efa-81137ab8186c tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:54.751035 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-8029828e-01e3-4dfd-8efa-81137ab8186c tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fac643eaad4a29913b3090c8931d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d504f39d52488abf8282bc0ec2786c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:54.761871 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-8029828e-01e3-4dfd-8efa-81137ab8186c tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] 10.222.0.25 "GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e" status: 200 len: 1471 microversion: 2.1 time: 0.432963 Sep 25 04:38:54.762464 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 240/425] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:54 2022] GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e => generated 1471 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:38:54.801648 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [req-86b09e53-e0c7-4bd9-8dff-0d4bf0f55fcb req-739b0795-819b-45a6-9785-e2e82e34b45f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "699c1287-b1cd-4872-911c-11a44f8b6a0e", "name": "network-vif-deleted", "tag": "f37d4706-1585-4270-94bf-7edaf49afe4a"}]} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:38:54.815629 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-86b09e53-e0c7-4bd9-8dff-0d4bf0f55fcb req-739b0795-819b-45a6-9785-e2e82e34b45f service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:54.816548 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-86b09e53-e0c7-4bd9-8dff-0d4bf0f55fcb req-739b0795-819b-45a6-9785-e2e82e34b45f service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:54.817380 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-86b09e53-e0c7-4bd9-8dff-0d4bf0f55fcb req-739b0795-819b-45a6-9785-e2e82e34b45f service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:54.836694 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.compute.server_external_events [req-86b09e53-e0c7-4bd9-8dff-0d4bf0f55fcb req-739b0795-819b-45a6-9785-e2e82e34b45f service nova] Creating event network-vif-deleted:f37d4706-1585-4270-94bf-7edaf49afe4a for instance 699c1287-b1cd-4872-911c-11a44f8b6a0e on hv-cinder-85535 Sep 25 04:38:54.850216 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [req-86b09e53-e0c7-4bd9-8dff-0d4bf0f55fcb req-739b0795-819b-45a6-9785-e2e82e34b45f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058999 Sep 25 04:38:54.855635 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 186/426] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 04:38:55.793522 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-23021961-a65c-4d84-9270-a56917924b89 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:55.794527 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-23021961-a65c-4d84-9270-a56917924b89 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] [instance: 699c1287-b1cd-4872-911c-11a44f8b6a0e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:55.804529 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-23021961-a65c-4d84-9270-a56917924b89 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:55.811602 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-23021961-a65c-4d84-9270-a56917924b89 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:55.812151 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-23021961-a65c-4d84-9270-a56917924b89 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:55.814344 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-23021961-a65c-4d84-9270-a56917924b89 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:55.814834 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-23021961-a65c-4d84-9270-a56917924b89 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:55.817204 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-23021961-a65c-4d84-9270-a56917924b89 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:55.859144 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-23021961-a65c-4d84-9270-a56917924b89 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:55.859624 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-23021961-a65c-4d84-9270-a56917924b89 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:55.860052 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-23021961-a65c-4d84-9270-a56917924b89 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:55.860583 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.objects.instance [None req-23021961-a65c-4d84-9270-a56917924b89 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lazy-loading 'fault' on Instance uuid 699c1287-b1cd-4872-911c-11a44f8b6a0e {{(pid=127142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 04:38:55.920123 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-23021961-a65c-4d84-9270-a56917924b89 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fac643eaad4a29913b3090c8931d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d504f39d52488abf8282bc0ec2786c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:38:55.927717 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-23021961-a65c-4d84-9270-a56917924b89 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] 10.222.0.25 "GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e" status: 200 len: 1305 microversion: 2.1 time: 0.141931 Sep 25 04:38:55.928288 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 241/427] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:55 2022] GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e => generated 1305 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:38:56.956415 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-e316bc33-3c74-4750-a1f5-707803bb20c9 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:38:56.957230 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-e316bc33-3c74-4750-a1f5-707803bb20c9 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] [instance: 699c1287-b1cd-4872-911c-11a44f8b6a0e] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:38:56.967042 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e316bc33-3c74-4750-a1f5-707803bb20c9 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:56.967546 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e316bc33-3c74-4750-a1f5-707803bb20c9 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:56.967986 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e316bc33-3c74-4750-a1f5-707803bb20c9 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:56.968712 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e316bc33-3c74-4750-a1f5-707803bb20c9 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:38:56.969170 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e316bc33-3c74-4750-a1f5-707803bb20c9 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:38:56.973113 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e316bc33-3c74-4750-a1f5-707803bb20c9 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:38:56.990751 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.wsgi [None req-e316bc33-3c74-4750-a1f5-707803bb20c9 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] HTTP exception thrown: Instance 699c1287-b1cd-4872-911c-11a44f8b6a0e could not be found. Sep 25 04:38:56.992630 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-e316bc33-3c74-4750-a1f5-707803bb20c9 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Request method failure captured: Sep 25 04:38:56.992630 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: request: GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e HTTP/1.1 Sep 25 04:38:56.992630 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept: application/json Sep 25 04:38:56.992630 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept-Encoding: identity Sep 25 04:38:56.992630 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Connection: close Sep 25 04:38:56.992630 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Length: 0 Sep 25 04:38:56.992630 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Type: application/json Sep 25 04:38:56.992630 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Host: 10.222.0.25 Sep 25 04:38:56.992630 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Openstack-System-Scope: None Sep 25 04:38:56.992630 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: User-Agent: python-urllib3/1.26.12 Sep 25 04:38:56.992630 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Auth-Token: gAAAAABjL9tFeO0LttST9rqe4jMu8D25CLqxsMvlJ8L__6-cadfIixPQF4OHQV2gJ_24UEToVe_zoU9YdBolt7ytYbZFFdyMfeyMJVJhj17JuNRhDqbuVFcfnzGR9moccs02irDjlerReMejSGFKIz6Jdz3VOoG-YOMVHREouwppDyFJRXmm1ZU Sep 25 04:38:56.992630 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Id: None Sep 25 04:38:56.992630 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Name: None Sep 25 04:38:56.992630 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Identity-Status: Confirmed Sep 25 04:38:56.992630 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Is-Admin-Project: True Sep 25 04:38:56.992630 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Id: default Sep 25 04:38:56.992630 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Name: Default Sep 25 04:38:56.992630 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Id: b7d504f39d52488abf8282bc0ec2786c Sep 25 04:38:56.992630 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Name: tempest-VolumesNegativeTest-796282419 Sep 25 04:38:56.992630 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Role: reader,member Sep 25 04:38:56.992630 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Roles: reader,member Sep 25 04:38:56.994746 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b7d504f39d52488abf8282bc0ec2786c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b7d504f39d52488abf8282bc0ec2786c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b7d504f39d52488abf8282bc0ec2786c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b7d504f39d52488abf8282bc0ec2786c"}]}] Sep 25 04:38:56.994746 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant: tempest-VolumesNegativeTest-796282419 Sep 25 04:38:56.994746 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Id: b7d504f39d52488abf8282bc0ec2786c Sep 25 04:38:56.994746 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Name: tempest-VolumesNegativeTest-796282419 Sep 25 04:38:56.994746 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User: tempest-VolumesNegativeTest-796282419-project Sep 25 04:38:56.994746 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Id: default Sep 25 04:38:56.994746 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Name: Default Sep 25 04:38:56.994746 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Id: 10fac643eaad4a29913b3090c8931d54 Sep 25 04:38:56.994746 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Name: tempest-VolumesNegativeTest-796282419-project Sep 25 04:38:56.994746 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: method: > Sep 25 04:38:56.994746 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: exception: Instance 699c1287-b1cd-4872-911c-11a44f8b6a0e could not be found. Sep 25 04:38:56.994746 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: action_args: {'id': '699c1287-b1cd-4872-911c-11a44f8b6a0e'} Sep 25 04:38:56.995570 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:38:56.995570 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:38:56.995570 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:38:56.995570 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:38:56.995570 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:38:56.995570 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:38:56.995570 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:38:56.995570 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:38:56.995570 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:38:56.995570 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:38:56.995570 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 699c1287-b1cd-4872-911c-11a44f8b6a0e could not be found. Sep 25 04:38:56.995570 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:38:56.995570 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:38:56.995570 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:38:56.995570 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:38:56.995570 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:38:56.995570 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:38:56.995570 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:38:56.995570 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:38:56.995570 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:38:56.996841 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:38:56.996841 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 04:38:56.996841 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 04:38:56.996841 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:38:56.996841 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:38:56.996841 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:38:56.996841 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:38:56.996841 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 699c1287-b1cd-4872-911c-11a44f8b6a0e could not be found. Sep 25 04:38:56.996841 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:38:56.996841 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:38:56.996841 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:38:56.996841 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:38:56.996841 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:38:56.996841 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:38:56.996841 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:38:56.996841 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:38:56.996841 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 699c1287-b1cd-4872-911c-11a44f8b6a0e could not be found. Sep 25 04:38:56.996841 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:38:57.000026 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-e316bc33-3c74-4750-a1f5-707803bb20c9 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] Returning 404 to user: Instance 699c1287-b1cd-4872-911c-11a44f8b6a0e could not be found. {{(pid=127141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:38:57.001446 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-e316bc33-3c74-4750-a1f5-707803bb20c9 tempest-VolumesNegativeTest-796282419 tempest-VolumesNegativeTest-796282419-project] 10.222.0.25 "GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e" status: 404 len: 111 microversion: 2.1 time: 0.049848 Sep 25 04:38:57.002432 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 187/428] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:38:56 2022] GET /compute/v2.1/servers/699c1287-b1cd-4872-911c-11a44f8b6a0e => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 04:39:01.480807 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-0827ac5c-18c6-426a-a7df-ce1baa7eeb7f tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Action: 'create', calling method: .version_select at 0x7f4d3ef734c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-998201584", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbMVRF9WCQchISNz3Oma/UiUr8UzsDsOO5gk5OgoiqKzu/xJykXfm9jX30lAhewbMGumoIMZReROv97dymDaTJprJi8r9/4tmMghs/YhDsDNJrsXof5fj0OF3EP1rXLNg=="}} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:39:01.486004 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:39:01.497992 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.quota [None req-0827ac5c-18c6-426a-a7df-ce1baa7eeb7f tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Getting quotas for project b5c1180472fb4243bd45e44914a46918. Resources: {'key_pairs'} {{(pid=127142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 04:39:01.502048 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.quota [None req-0827ac5c-18c6-426a-a7df-ce1baa7eeb7f tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Getting quotas for user 5902801c596048389599b2b18df16dd4 and project b5c1180472fb4243bd45e44914a46918. Resources: {'key_pairs'} {{(pid=127142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 04:39:01.525696 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-0827ac5c-18c6-426a-a7df-ce1baa7eeb7f tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.049061 Sep 25 04:39:01.526633 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 242/429] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 25 04:39:01 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:39:01.577592 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-f9302a89-4f05-4c86-87e6-2e8b29c2978f tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2139294565", "imageRef": "3edbfe61-cddf-473a-bc16-eeacae949b60", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-998201584", "networks": [{"uuid": "b3eadb07-6aaa-4fcd-8aef-63aa561f8322"}]}} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:39:01.586770 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:39:01.637534 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.network.neutron [None req-f9302a89-4f05-4c86-87e6-2e8b29c2978f tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] validate_networks() for [('b3eadb07-6aaa-4fcd-8aef-63aa561f8322', None, None, None, None, None)] {{(pid=127141) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 04:39:02.031028 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-f9302a89-4f05-4c86-87e6-2e8b29c2978f tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Flavor limits 0:0:0 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 04:39:02.031559 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-f9302a89-4f05-4c86-87e6-2e8b29c2978f tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Image limits 0:0:0 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 04:39:02.032103 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-f9302a89-4f05-4c86-87e6-2e8b29c2978f tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Flavor pref 0:0:0 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 04:39:02.032519 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-f9302a89-4f05-4c86-87e6-2e8b29c2978f tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Image pref 0:0:0 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 04:39:02.032967 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-f9302a89-4f05-4c86-87e6-2e8b29c2978f tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 04:39:02.041985 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f9302a89-4f05-4c86-87e6-2e8b29c2978f tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:02.042468 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f9302a89-4f05-4c86-87e6-2e8b29c2978f tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:02.042902 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f9302a89-4f05-4c86-87e6-2e8b29c2978f tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:02.043637 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f9302a89-4f05-4c86-87e6-2e8b29c2978f tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:02.044090 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f9302a89-4f05-4c86-87e6-2e8b29c2978f tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:02.044518 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f9302a89-4f05-4c86-87e6-2e8b29c2978f tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:02.063217 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.quota [None req-f9302a89-4f05-4c86-87e6-2e8b29c2978f tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Getting quotas for project b5c1180472fb4243bd45e44914a46918. Resources: {'instances', 'ram', 'cores'} {{(pid=127141) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 04:39:02.067574 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.quota [None req-f9302a89-4f05-4c86-87e6-2e8b29c2978f tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Getting quotas for user 5902801c596048389599b2b18df16dd4 and project b5c1180472fb4243bd45e44914a46918. Resources: {'instances', 'ram', 'cores'} {{(pid=127141) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 04:39:02.079304 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-f9302a89-4f05-4c86-87e6-2e8b29c2978f tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Going to run 1 instances... {{(pid=127141) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 04:39:02.082244 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-f9302a89-4f05-4c86-87e6-2e8b29c2978f tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3edbfe61-cddf-473a-bc16-eeacae949b60',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127141) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 04:39:02.128616 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f9302a89-4f05-4c86-87e6-2e8b29c2978f tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [aca267f7-a1dd-46f2-8d49-ab6d58681eed] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 25 04:39:03.135502 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO oslo.messaging._drivers.impl_rabbit [None req-f9302a89-4f05-4c86-87e6-2e8b29c2978f tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [aca267f7-a1dd-46f2-8d49-ab6d58681eed] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 38926. Sep 25 04:39:03.139732 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-f9302a89-4f05-4c86-87e6-2e8b29c2978f tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.565951 Sep 25 04:39:03.140369 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 188/430] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 25 04:39:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 04:39:03.151137 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-eed51ce6-8b07-4bcf-9d1b-1ba432a988cf tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:03.151747 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-eed51ce6-8b07-4bcf-9d1b-1ba432a988cf tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:03.209502 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-eed51ce6-8b07-4bcf-9d1b-1ba432a988cf tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:03.216432 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-eed51ce6-8b07-4bcf-9d1b-1ba432a988cf tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1258 microversion: 2.1 time: 0.069172 Sep 25 04:39:03.217101 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 243/431] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:03 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:04.239898 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-8b0f56ff-1092-46c4-ad21-583828cfdf9e tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:04.240513 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-8b0f56ff-1092-46c4-ad21-583828cfdf9e tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:04.247161 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8b0f56ff-1092-46c4-ad21-583828cfdf9e tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:04.247643 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8b0f56ff-1092-46c4-ad21-583828cfdf9e tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:04.248082 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8b0f56ff-1092-46c4-ad21-583828cfdf9e tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:04.248792 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8b0f56ff-1092-46c4-ad21-583828cfdf9e tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:04.249248 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8b0f56ff-1092-46c4-ad21-583828cfdf9e tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:04.249701 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8b0f56ff-1092-46c4-ad21-583828cfdf9e tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:04.309890 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-8b0f56ff-1092-46c4-ad21-583828cfdf9e tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:04.317477 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-8b0f56ff-1092-46c4-ad21-583828cfdf9e tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1310 microversion: 2.1 time: 0.082077 Sep 25 04:39:04.318032 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 189/432] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:04 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1310 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:05.341451 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-9e4b8383-c21e-4e2b-83bc-2f63f9baa678 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:05.342667 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-9e4b8383-c21e-4e2b-83bc-2f63f9baa678 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:05.349994 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9e4b8383-c21e-4e2b-83bc-2f63f9baa678 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:05.350726 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9e4b8383-c21e-4e2b-83bc-2f63f9baa678 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:05.351167 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9e4b8383-c21e-4e2b-83bc-2f63f9baa678 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:05.351876 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9e4b8383-c21e-4e2b-83bc-2f63f9baa678 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:05.352422 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9e4b8383-c21e-4e2b-83bc-2f63f9baa678 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:05.353569 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9e4b8383-c21e-4e2b-83bc-2f63f9baa678 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:05.507383 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-9e4b8383-c21e-4e2b-83bc-2f63f9baa678 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:05.515717 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-9e4b8383-c21e-4e2b-83bc-2f63f9baa678 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1358 microversion: 2.1 time: 0.178040 Sep 25 04:39:05.516212 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 244/433] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:05 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:06.539464 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-adbbd229-037a-47d5-9d53-139088109df6 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:06.540080 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-adbbd229-037a-47d5-9d53-139088109df6 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:06.547109 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-adbbd229-037a-47d5-9d53-139088109df6 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:06.547605 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-adbbd229-037a-47d5-9d53-139088109df6 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:06.548050 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-adbbd229-037a-47d5-9d53-139088109df6 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:06.548789 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-adbbd229-037a-47d5-9d53-139088109df6 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:06.549254 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-adbbd229-037a-47d5-9d53-139088109df6 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:06.549683 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-adbbd229-037a-47d5-9d53-139088109df6 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:06.705712 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-adbbd229-037a-47d5-9d53-139088109df6 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:06.715190 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-adbbd229-037a-47d5-9d53-139088109df6 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1358 microversion: 2.1 time: 0.179577 Sep 25 04:39:06.729193 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 190/434] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:06 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:07.738441 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-94b25700-5b77-4a4f-8763-11522c1b139a tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:07.739277 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-94b25700-5b77-4a4f-8763-11522c1b139a tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:07.747245 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-94b25700-5b77-4a4f-8763-11522c1b139a tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:07.747965 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-94b25700-5b77-4a4f-8763-11522c1b139a tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:07.748522 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-94b25700-5b77-4a4f-8763-11522c1b139a tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:07.749448 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-94b25700-5b77-4a4f-8763-11522c1b139a tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:07.749908 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-94b25700-5b77-4a4f-8763-11522c1b139a tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:07.750336 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-94b25700-5b77-4a4f-8763-11522c1b139a tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:07.885951 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-94b25700-5b77-4a4f-8763-11522c1b139a tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:07.893600 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-94b25700-5b77-4a4f-8763-11522c1b139a tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1358 microversion: 2.1 time: 0.159281 Sep 25 04:39:07.894169 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 245/435] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:07 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:08.917354 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-d0fd17e1-a7cb-46fe-abef-ced9b463cb2b tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:08.917968 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-d0fd17e1-a7cb-46fe-abef-ced9b463cb2b tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:08.924311 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d0fd17e1-a7cb-46fe-abef-ced9b463cb2b tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:08.924837 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d0fd17e1-a7cb-46fe-abef-ced9b463cb2b tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:08.925275 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d0fd17e1-a7cb-46fe-abef-ced9b463cb2b tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:08.925958 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d0fd17e1-a7cb-46fe-abef-ced9b463cb2b tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:08.926410 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d0fd17e1-a7cb-46fe-abef-ced9b463cb2b tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:08.926838 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d0fd17e1-a7cb-46fe-abef-ced9b463cb2b tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:09.062991 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-d0fd17e1-a7cb-46fe-abef-ced9b463cb2b tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:09.070668 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-d0fd17e1-a7cb-46fe-abef-ced9b463cb2b tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1358 microversion: 2.1 time: 0.157873 Sep 25 04:39:09.071438 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 191/436] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:08 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:10.094286 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-21025fc7-83a6-43a9-9ec9-636aebc2f43c tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:10.094901 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-21025fc7-83a6-43a9-9ec9-636aebc2f43c tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:10.100880 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-21025fc7-83a6-43a9-9ec9-636aebc2f43c tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:10.101370 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-21025fc7-83a6-43a9-9ec9-636aebc2f43c tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:10.101810 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-21025fc7-83a6-43a9-9ec9-636aebc2f43c tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:10.102527 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-21025fc7-83a6-43a9-9ec9-636aebc2f43c tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:10.102994 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-21025fc7-83a6-43a9-9ec9-636aebc2f43c tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:10.103963 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-21025fc7-83a6-43a9-9ec9-636aebc2f43c tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:10.261474 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-21025fc7-83a6-43a9-9ec9-636aebc2f43c tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:10.269117 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-21025fc7-83a6-43a9-9ec9-636aebc2f43c tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1358 microversion: 2.1 time: 0.178642 Sep 25 04:39:10.269678 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 246/437] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:10 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:11.296379 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-5680e0e9-ed34-4aa8-b1a8-a73b8b888348 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:11.297024 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-5680e0e9-ed34-4aa8-b1a8-a73b8b888348 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:11.303409 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5680e0e9-ed34-4aa8-b1a8-a73b8b888348 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:11.303888 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5680e0e9-ed34-4aa8-b1a8-a73b8b888348 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:11.304324 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5680e0e9-ed34-4aa8-b1a8-a73b8b888348 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:11.305035 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5680e0e9-ed34-4aa8-b1a8-a73b8b888348 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:11.305495 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5680e0e9-ed34-4aa8-b1a8-a73b8b888348 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:11.305918 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5680e0e9-ed34-4aa8-b1a8-a73b8b888348 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:11.443066 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-5680e0e9-ed34-4aa8-b1a8-a73b8b888348 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:11.450942 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-5680e0e9-ed34-4aa8-b1a8-a73b8b888348 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1358 microversion: 2.1 time: 0.158387 Sep 25 04:39:11.451502 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 192/438] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:11 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:39:12.474045 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-9588356f-8fac-4600-be93-1e593ce200a9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:12.474651 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-9588356f-8fac-4600-be93-1e593ce200a9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:12.481429 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9588356f-8fac-4600-be93-1e593ce200a9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:12.481909 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9588356f-8fac-4600-be93-1e593ce200a9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:12.482339 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9588356f-8fac-4600-be93-1e593ce200a9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:12.483022 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9588356f-8fac-4600-be93-1e593ce200a9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:12.483467 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9588356f-8fac-4600-be93-1e593ce200a9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:12.483885 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9588356f-8fac-4600-be93-1e593ce200a9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:12.615823 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-9588356f-8fac-4600-be93-1e593ce200a9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:12.624976 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-9588356f-8fac-4600-be93-1e593ce200a9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1358 microversion: 2.1 time: 0.154812 Sep 25 04:39:12.626349 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 247/439] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:12 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:13.649222 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-47d39766-74dc-4477-8d45-410b9b8222e8 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:13.650710 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-47d39766-74dc-4477-8d45-410b9b8222e8 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:13.655177 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell0:SELECT=2 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:39:13.656027 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell0:SELECT=6 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:39:13.664485 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-47d39766-74dc-4477-8d45-410b9b8222e8 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:13.665024 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-47d39766-74dc-4477-8d45-410b9b8222e8 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:13.665466 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-47d39766-74dc-4477-8d45-410b9b8222e8 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:13.667016 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-47d39766-74dc-4477-8d45-410b9b8222e8 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:13.667534 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-47d39766-74dc-4477-8d45-410b9b8222e8 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:13.667962 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-47d39766-74dc-4477-8d45-410b9b8222e8 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:13.810243 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-47d39766-74dc-4477-8d45-410b9b8222e8 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:13.818213 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-47d39766-74dc-4477-8d45-410b9b8222e8 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1358 microversion: 2.1 time: 0.172919 Sep 25 04:39:13.819111 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 193/440] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:13 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:14.842819 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-b8b94b65-62d3-473f-ba7c-9467a8990bdd tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:14.843555 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-b8b94b65-62d3-473f-ba7c-9467a8990bdd tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:14.845549 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell0:SELECT=6 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:39:14.851917 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b8b94b65-62d3-473f-ba7c-9467a8990bdd tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:14.852416 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b8b94b65-62d3-473f-ba7c-9467a8990bdd tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:14.852881 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b8b94b65-62d3-473f-ba7c-9467a8990bdd tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:14.853706 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b8b94b65-62d3-473f-ba7c-9467a8990bdd tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:14.854163 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b8b94b65-62d3-473f-ba7c-9467a8990bdd tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:14.854587 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b8b94b65-62d3-473f-ba7c-9467a8990bdd tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:14.992526 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-b8b94b65-62d3-473f-ba7c-9467a8990bdd tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:15.000898 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-b8b94b65-62d3-473f-ba7c-9467a8990bdd tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1358 microversion: 2.1 time: 0.162979 Sep 25 04:39:15.001466 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 248/441] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:14 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:16.029039 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-2f1d2c1e-38d3-4821-9b44-71633ed8b262 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:16.029845 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-2f1d2c1e-38d3-4821-9b44-71633ed8b262 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:16.038816 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2f1d2c1e-38d3-4821-9b44-71633ed8b262 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:16.039285 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2f1d2c1e-38d3-4821-9b44-71633ed8b262 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:16.039722 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2f1d2c1e-38d3-4821-9b44-71633ed8b262 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:16.040427 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2f1d2c1e-38d3-4821-9b44-71633ed8b262 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:16.040901 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2f1d2c1e-38d3-4821-9b44-71633ed8b262 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:16.041564 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2f1d2c1e-38d3-4821-9b44-71633ed8b262 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:16.176813 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-2f1d2c1e-38d3-4821-9b44-71633ed8b262 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:16.185369 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-2f1d2c1e-38d3-4821-9b44-71633ed8b262 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1358 microversion: 2.1 time: 0.162553 Sep 25 04:39:16.185924 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 194/442] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:16 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:17.209872 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-c19b9ce8-6765-42c2-8e8c-ca9cb51508b3 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:17.210511 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-c19b9ce8-6765-42c2-8e8c-ca9cb51508b3 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:17.217319 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c19b9ce8-6765-42c2-8e8c-ca9cb51508b3 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:17.217802 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c19b9ce8-6765-42c2-8e8c-ca9cb51508b3 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:17.218236 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c19b9ce8-6765-42c2-8e8c-ca9cb51508b3 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:17.218918 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c19b9ce8-6765-42c2-8e8c-ca9cb51508b3 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:17.219367 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c19b9ce8-6765-42c2-8e8c-ca9cb51508b3 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:17.219785 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c19b9ce8-6765-42c2-8e8c-ca9cb51508b3 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:17.348849 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-c19b9ce8-6765-42c2-8e8c-ca9cb51508b3 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:17.356451 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-c19b9ce8-6765-42c2-8e8c-ca9cb51508b3 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1358 microversion: 2.1 time: 0.150698 Sep 25 04:39:17.357031 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 249/443] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:17 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:18.379442 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-c96545b9-f7d6-4414-8e28-613f4b039b38 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:18.380053 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-c96545b9-f7d6-4414-8e28-613f4b039b38 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:18.386593 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c96545b9-f7d6-4414-8e28-613f4b039b38 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:18.387073 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c96545b9-f7d6-4414-8e28-613f4b039b38 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:18.387510 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c96545b9-f7d6-4414-8e28-613f4b039b38 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:18.388193 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c96545b9-f7d6-4414-8e28-613f4b039b38 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:18.388662 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c96545b9-f7d6-4414-8e28-613f4b039b38 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:18.389102 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c96545b9-f7d6-4414-8e28-613f4b039b38 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:18.391609 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:39:18.519500 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-c96545b9-f7d6-4414-8e28-613f4b039b38 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:18.527830 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-c96545b9-f7d6-4414-8e28-613f4b039b38 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1358 microversion: 2.1 time: 0.152229 Sep 25 04:39:18.528394 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 195/444] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:18 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:19.551255 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-73ce123b-f341-4062-bcdc-f0da443ebb76 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:19.552000 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-73ce123b-f341-4062-bcdc-f0da443ebb76 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:19.559575 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-73ce123b-f341-4062-bcdc-f0da443ebb76 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:19.560295 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-73ce123b-f341-4062-bcdc-f0da443ebb76 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:19.560762 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-73ce123b-f341-4062-bcdc-f0da443ebb76 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:19.561465 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-73ce123b-f341-4062-bcdc-f0da443ebb76 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:19.561919 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-73ce123b-f341-4062-bcdc-f0da443ebb76 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:19.562338 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-73ce123b-f341-4062-bcdc-f0da443ebb76 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:19.769140 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-73ce123b-f341-4062-bcdc-f0da443ebb76 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:19.776747 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-73ce123b-f341-4062-bcdc-f0da443ebb76 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1358 microversion: 2.1 time: 0.229317 Sep 25 04:39:19.777320 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 250/445] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:19 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:20.009307 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [req-a892abd4-6711-4b1e-8009-80f0515baa2f req-3f85d339-68da-4a8d-92e2-40a50f17a7f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6582b313-e063-4d3f-940f-5ffba2370c65", "tag": "1a0b90ca-b310-46fa-adf6-563e2d00f49d"}]} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:39:20.019773 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-a892abd4-6711-4b1e-8009-80f0515baa2f req-3f85d339-68da-4a8d-92e2-40a50f17a7f7 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:20.020278 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-a892abd4-6711-4b1e-8009-80f0515baa2f req-3f85d339-68da-4a8d-92e2-40a50f17a7f7 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:20.020827 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-a892abd4-6711-4b1e-8009-80f0515baa2f req-3f85d339-68da-4a8d-92e2-40a50f17a7f7 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:20.032586 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.compute.server_external_events [req-a892abd4-6711-4b1e-8009-80f0515baa2f req-3f85d339-68da-4a8d-92e2-40a50f17a7f7 service nova] Creating event network-changed:1a0b90ca-b310-46fa-adf6-563e2d00f49d for instance 6582b313-e063-4d3f-940f-5ffba2370c65 on hv-cinder-85535 Sep 25 04:39:20.037377 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [req-a892abd4-6711-4b1e-8009-80f0515baa2f req-3f85d339-68da-4a8d-92e2-40a50f17a7f7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031950 Sep 25 04:39:20.037956 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 196/446] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 04:39:20.800878 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-5ff77a3b-185d-4c42-9e5a-377fb84b1f09 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:20.801490 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-5ff77a3b-185d-4c42-9e5a-377fb84b1f09 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:20.808050 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5ff77a3b-185d-4c42-9e5a-377fb84b1f09 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:20.808556 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5ff77a3b-185d-4c42-9e5a-377fb84b1f09 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:20.809020 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5ff77a3b-185d-4c42-9e5a-377fb84b1f09 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:20.809728 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5ff77a3b-185d-4c42-9e5a-377fb84b1f09 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:20.810181 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5ff77a3b-185d-4c42-9e5a-377fb84b1f09 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:20.810601 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5ff77a3b-185d-4c42-9e5a-377fb84b1f09 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:20.936323 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-5ff77a3b-185d-4c42-9e5a-377fb84b1f09 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:20.943954 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-5ff77a3b-185d-4c42-9e5a-377fb84b1f09 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1358 microversion: 2.1 time: 0.146924 Sep 25 04:39:20.944506 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 251/447] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:20 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:21.968962 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-43f24123-c274-4c35-8121-66b01ba2474b tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:21.969667 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-43f24123-c274-4c35-8121-66b01ba2474b tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:21.975814 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-43f24123-c274-4c35-8121-66b01ba2474b tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:21.976301 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-43f24123-c274-4c35-8121-66b01ba2474b tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:21.976767 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-43f24123-c274-4c35-8121-66b01ba2474b tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:21.977462 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-43f24123-c274-4c35-8121-66b01ba2474b tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:21.977919 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-43f24123-c274-4c35-8121-66b01ba2474b tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:21.978346 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-43f24123-c274-4c35-8121-66b01ba2474b tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:22.106423 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-43f24123-c274-4c35-8121-66b01ba2474b tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:22.114053 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-43f24123-c274-4c35-8121-66b01ba2474b tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1358 microversion: 2.1 time: 0.150321 Sep 25 04:39:22.114613 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 197/448] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:21 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:22.273267 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-d58f55f6-dcbe-4ccc-89b2-f182e60d6e63 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:22.273795 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-d58f55f6-dcbe-4ccc-89b2-f182e60d6e63 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:22.280210 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d58f55f6-dcbe-4ccc-89b2-f182e60d6e63 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:22.280729 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d58f55f6-dcbe-4ccc-89b2-f182e60d6e63 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:22.281165 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d58f55f6-dcbe-4ccc-89b2-f182e60d6e63 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:22.281845 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d58f55f6-dcbe-4ccc-89b2-f182e60d6e63 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:22.282299 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d58f55f6-dcbe-4ccc-89b2-f182e60d6e63 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:22.282718 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d58f55f6-dcbe-4ccc-89b2-f182e60d6e63 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:22.285087 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=65 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:39:22.306701 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-d58f55f6-dcbe-4ccc-89b2-f182e60d6e63 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632/ips" status: 200 len: 147 microversion: 2.1 time: 0.037404 Sep 25 04:39:22.307250 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 252/449] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Sep 25 04:39:22 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632/ips => generated 147 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:39:23.138051 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-b8078620-d3b7-4d4f-8d8f-05dc334cffb9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:23.138607 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-b8078620-d3b7-4d4f-8d8f-05dc334cffb9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:23.145011 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b8078620-d3b7-4d4f-8d8f-05dc334cffb9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:23.145488 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b8078620-d3b7-4d4f-8d8f-05dc334cffb9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:23.145917 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b8078620-d3b7-4d4f-8d8f-05dc334cffb9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:23.146590 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b8078620-d3b7-4d4f-8d8f-05dc334cffb9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:23.147038 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b8078620-d3b7-4d4f-8d8f-05dc334cffb9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:23.147455 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b8078620-d3b7-4d4f-8d8f-05dc334cffb9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:23.276424 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-b8078620-d3b7-4d4f-8d8f-05dc334cffb9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:23.284068 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-b8078620-d3b7-4d4f-8d8f-05dc334cffb9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1358 microversion: 2.1 time: 0.150817 Sep 25 04:39:23.284654 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 198/450] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:23 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:24.306854 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-7a3c75e3-4657-4454-b37e-353d1be95bfb tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:24.307396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-7a3c75e3-4657-4454-b37e-353d1be95bfb tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:24.313435 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7a3c75e3-4657-4454-b37e-353d1be95bfb tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:24.313918 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7a3c75e3-4657-4454-b37e-353d1be95bfb tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:24.314353 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7a3c75e3-4657-4454-b37e-353d1be95bfb tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:24.315036 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7a3c75e3-4657-4454-b37e-353d1be95bfb tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:24.315486 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7a3c75e3-4657-4454-b37e-353d1be95bfb tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:24.315907 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7a3c75e3-4657-4454-b37e-353d1be95bfb tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:24.518589 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-7a3c75e3-4657-4454-b37e-353d1be95bfb tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:24.526016 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-7a3c75e3-4657-4454-b37e-353d1be95bfb tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1358 microversion: 2.1 time: 0.223130 Sep 25 04:39:24.526890 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 253/451] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:24 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:25.548762 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-791dacd0-21ba-4e12-9b1d-07385ca3bb14 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:25.549396 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-791dacd0-21ba-4e12-9b1d-07385ca3bb14 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:25.555785 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-791dacd0-21ba-4e12-9b1d-07385ca3bb14 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:25.556260 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-791dacd0-21ba-4e12-9b1d-07385ca3bb14 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:25.556730 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-791dacd0-21ba-4e12-9b1d-07385ca3bb14 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:25.557420 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-791dacd0-21ba-4e12-9b1d-07385ca3bb14 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:25.557868 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-791dacd0-21ba-4e12-9b1d-07385ca3bb14 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:25.558285 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-791dacd0-21ba-4e12-9b1d-07385ca3bb14 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:25.696805 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-791dacd0-21ba-4e12-9b1d-07385ca3bb14 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:25.705159 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-791dacd0-21ba-4e12-9b1d-07385ca3bb14 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1358 microversion: 2.1 time: 0.160179 Sep 25 04:39:25.705930 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 199/452] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:25 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:26.173842 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-a8512587-a3ce-4a41-956c-e431db555ab8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "898d3f9f-1812-4126-8381-0d77e1c21571"}} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:39:26.176250 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-a8512587-a3ce-4a41-956c-e431db555ab8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:26.182167 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a8512587-a3ce-4a41-956c-e431db555ab8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:26.182645 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a8512587-a3ce-4a41-956c-e431db555ab8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:26.183078 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a8512587-a3ce-4a41-956c-e431db555ab8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:26.183789 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a8512587-a3ce-4a41-956c-e431db555ab8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:26.184546 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a8512587-a3ce-4a41-956c-e431db555ab8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:26.185002 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a8512587-a3ce-4a41-956c-e431db555ab8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:26.485468 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-a8512587-a3ce-4a41-956c-e431db555ab8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "POST /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.315139 Sep 25 04:39:26.491816 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 254/453] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Sep 25 04:39:26 2022] POST /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632/os-volume_attachments => generated 194 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:39:26.729492 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-b24078ed-941a-4239-ac03-d0199afe8616 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:26.730101 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-b24078ed-941a-4239-ac03-d0199afe8616 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:26.737391 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b24078ed-941a-4239-ac03-d0199afe8616 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:26.737876 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b24078ed-941a-4239-ac03-d0199afe8616 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:26.738307 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b24078ed-941a-4239-ac03-d0199afe8616 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:26.738982 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b24078ed-941a-4239-ac03-d0199afe8616 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:26.739435 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b24078ed-941a-4239-ac03-d0199afe8616 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:26.739855 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b24078ed-941a-4239-ac03-d0199afe8616 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:26.866953 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-b24078ed-941a-4239-ac03-d0199afe8616 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:26.875076 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-b24078ed-941a-4239-ac03-d0199afe8616 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1358 microversion: 2.1 time: 0.149384 Sep 25 04:39:26.875644 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 200/454] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:26 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:27.884378 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-08a72d25-0b30-43da-829f-e24d8ff6ab9b req-02a4b94d-97f3-4513-89eb-70cabfba97c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6582b313-e063-4d3f-940f-5ffba2370c65", "name": "network-vif-plugged", "status": "completed", "tag": "1a0b90ca-b310-46fa-adf6-563e2d00f49d"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:39:27.897667 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-08a72d25-0b30-43da-829f-e24d8ff6ab9b req-02a4b94d-97f3-4513-89eb-70cabfba97c1 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:27.898149 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-08a72d25-0b30-43da-829f-e24d8ff6ab9b req-02a4b94d-97f3-4513-89eb-70cabfba97c1 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:27.898572 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-08a72d25-0b30-43da-829f-e24d8ff6ab9b req-02a4b94d-97f3-4513-89eb-70cabfba97c1 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:27.899081 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-3971e235-58be-405a-b4d9-a6c644ba197c tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:27.899703 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-3971e235-58be-405a-b4d9-a6c644ba197c tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:27.906106 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3971e235-58be-405a-b4d9-a6c644ba197c tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:27.906823 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3971e235-58be-405a-b4d9-a6c644ba197c tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:27.907266 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3971e235-58be-405a-b4d9-a6c644ba197c tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:27.908030 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3971e235-58be-405a-b4d9-a6c644ba197c tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:27.908491 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3971e235-58be-405a-b4d9-a6c644ba197c tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:27.908959 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3971e235-58be-405a-b4d9-a6c644ba197c tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:27.909977 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-08a72d25-0b30-43da-829f-e24d8ff6ab9b req-02a4b94d-97f3-4513-89eb-70cabfba97c1 service nova] Creating event network-vif-plugged:1a0b90ca-b310-46fa-adf6-563e2d00f49d for instance 6582b313-e063-4d3f-940f-5ffba2370c65 on hv-cinder-85535 Sep 25 04:39:27.915047 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-08a72d25-0b30-43da-829f-e24d8ff6ab9b req-02a4b94d-97f3-4513-89eb-70cabfba97c1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034724 Sep 25 04:39:27.916186 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 255/455] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 04:39:28.042603 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-3971e235-58be-405a-b4d9-a6c644ba197c tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:28.050819 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-3971e235-58be-405a-b4d9-a6c644ba197c tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1358 microversion: 2.1 time: 0.156036 Sep 25 04:39:28.051389 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 201/456] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:27 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:29.077653 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-0c47ac70-d7f8-4674-a6db-c9a3f52eaa16 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:29.078341 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-0c47ac70-d7f8-4674-a6db-c9a3f52eaa16 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:29.085157 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0c47ac70-d7f8-4674-a6db-c9a3f52eaa16 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:29.085634 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0c47ac70-d7f8-4674-a6db-c9a3f52eaa16 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:29.086066 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0c47ac70-d7f8-4674-a6db-c9a3f52eaa16 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:29.086736 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0c47ac70-d7f8-4674-a6db-c9a3f52eaa16 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:29.087179 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0c47ac70-d7f8-4674-a6db-c9a3f52eaa16 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:29.087615 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0c47ac70-d7f8-4674-a6db-c9a3f52eaa16 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:29.217721 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-0c47ac70-d7f8-4674-a6db-c9a3f52eaa16 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:29.225585 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-0c47ac70-d7f8-4674-a6db-c9a3f52eaa16 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1358 microversion: 2.1 time: 0.153691 Sep 25 04:39:29.226147 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 256/457] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:29 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:30.248855 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-283d176e-7b85-490c-adfe-5a3cffeb0352 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:30.249458 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-283d176e-7b85-490c-adfe-5a3cffeb0352 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:30.255807 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-283d176e-7b85-490c-adfe-5a3cffeb0352 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:30.256283 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-283d176e-7b85-490c-adfe-5a3cffeb0352 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:30.256745 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-283d176e-7b85-490c-adfe-5a3cffeb0352 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:30.257449 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-283d176e-7b85-490c-adfe-5a3cffeb0352 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:30.257898 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-283d176e-7b85-490c-adfe-5a3cffeb0352 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:30.258316 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-283d176e-7b85-490c-adfe-5a3cffeb0352 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:30.393041 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-283d176e-7b85-490c-adfe-5a3cffeb0352 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:30.400682 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-283d176e-7b85-490c-adfe-5a3cffeb0352 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1358 microversion: 2.1 time: 0.155832 Sep 25 04:39:30.401236 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 202/458] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:30 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:31.423785 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-e495d9b1-e527-45c7-8f22-8afea239f448 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:31.424381 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-e495d9b1-e527-45c7-8f22-8afea239f448 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:31.430877 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e495d9b1-e527-45c7-8f22-8afea239f448 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:31.431351 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e495d9b1-e527-45c7-8f22-8afea239f448 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:31.431778 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e495d9b1-e527-45c7-8f22-8afea239f448 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:31.432450 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e495d9b1-e527-45c7-8f22-8afea239f448 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:31.432923 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e495d9b1-e527-45c7-8f22-8afea239f448 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:31.433342 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e495d9b1-e527-45c7-8f22-8afea239f448 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:31.562045 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-e495d9b1-e527-45c7-8f22-8afea239f448 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:31.569743 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-e495d9b1-e527-45c7-8f22-8afea239f448 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1548 microversion: 2.1 time: 0.149755 Sep 25 04:39:31.570305 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 257/459] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:31 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:31.592515 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-d2074697-5725-4910-86df-9d61c47e490e tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:31.593177 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-d2074697-5725-4910-86df-9d61c47e490e tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:31.599541 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d2074697-5725-4910-86df-9d61c47e490e tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:31.600031 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d2074697-5725-4910-86df-9d61c47e490e tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:31.600470 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d2074697-5725-4910-86df-9d61c47e490e tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:31.601248 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d2074697-5725-4910-86df-9d61c47e490e tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:31.601708 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d2074697-5725-4910-86df-9d61c47e490e tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:31.602140 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d2074697-5725-4910-86df-9d61c47e490e tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:31.731522 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-d2074697-5725-4910-86df-9d61c47e490e tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:31.739431 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-d2074697-5725-4910-86df-9d61c47e490e tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1548 microversion: 2.1 time: 0.151044 Sep 25 04:39:31.740189 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 203/460] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:31 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:31.762154 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-7047d850-e486-45b0-8d61-5c364d70f5f6 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:31.767028 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-7047d850-e486-45b0-8d61-5c364d70f5f6 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:31.767785 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-7047d850-e486-45b0-8d61-5c364d70f5f6 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Searching by: {'deleted': False, 'project_id': 'b5c1180472fb4243bd45e44914a46918'} {{(pid=127142) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 04:39:31.769706 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:39:31.775988 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7047d850-e486-45b0-8d61-5c364d70f5f6 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:31.776464 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7047d850-e486-45b0-8d61-5c364d70f5f6 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:31.776918 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7047d850-e486-45b0-8d61-5c364d70f5f6 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:31.777659 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7047d850-e486-45b0-8d61-5c364d70f5f6 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:31.778137 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7047d850-e486-45b0-8d61-5c364d70f5f6 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:31.778556 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7047d850-e486-45b0-8d61-5c364d70f5f6 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:31.869650 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.multi_cell_list [None req-7047d850-e486-45b0-8d61-5c364d70f5f6 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127142) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 25 04:39:31.961750 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-7047d850-e486-45b0-8d61-5c364d70f5f6 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.203228 Sep 25 04:39:31.962207 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 258/461] 10.222.0.25 () {58 vars in 1125 bytes} [Sun Sep 25 04:39:31 2022] GET /compute/v2.1/servers => generated 343 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:39:31.973794 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-0a9b60a1-a8eb-487c-be2a-b0daf33805a3 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:31.974409 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-0a9b60a1-a8eb-487c-be2a-b0daf33805a3 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:31.976477 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:39:31.981860 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0a9b60a1-a8eb-487c-be2a-b0daf33805a3 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:31.982867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0a9b60a1-a8eb-487c-be2a-b0daf33805a3 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:31.983342 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0a9b60a1-a8eb-487c-be2a-b0daf33805a3 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:31.984039 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0a9b60a1-a8eb-487c-be2a-b0daf33805a3 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:31.984502 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0a9b60a1-a8eb-487c-be2a-b0daf33805a3 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:31.984954 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0a9b60a1-a8eb-487c-be2a-b0daf33805a3 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:32.110769 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-0a9b60a1-a8eb-487c-be2a-b0daf33805a3 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:32.118357 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-0a9b60a1-a8eb-487c-be2a-b0daf33805a3 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1548 microversion: 2.1 time: 0.148443 Sep 25 04:39:32.118914 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 204/462] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:31 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:34.034627 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-aaf644c0-83b0-4649-aad0-8cf18db7e4ea tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:39:34.041093 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-aaf644c0-83b0-4649-aad0-8cf18db7e4ea tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:34.041659 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-aaf644c0-83b0-4649-aad0-8cf18db7e4ea tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:34.042095 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-aaf644c0-83b0-4649-aad0-8cf18db7e4ea tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:34.112773 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-aaf644c0-83b0-4649-aad0-8cf18db7e4ea tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Going to try to stop instance {{(pid=127142) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 25 04:39:34.157795 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-aaf644c0-83b0-4649-aad0-8cf18db7e4ea tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "POST /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632/action" status: 202 len: 0 microversion: 2.1 time: 0.126986 Sep 25 04:39:34.158385 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 259/463] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 25 04:39:34 2022] POST /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 04:39:34.166533 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-22ac5d8c-4782-4fbd-b902-d55f609de1a1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:34.167141 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-22ac5d8c-4782-4fbd-b902-d55f609de1a1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:34.174639 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-22ac5d8c-4782-4fbd-b902-d55f609de1a1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:34.175090 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-22ac5d8c-4782-4fbd-b902-d55f609de1a1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:34.175532 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-22ac5d8c-4782-4fbd-b902-d55f609de1a1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:34.176220 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-22ac5d8c-4782-4fbd-b902-d55f609de1a1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:34.176693 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-22ac5d8c-4782-4fbd-b902-d55f609de1a1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:34.177119 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-22ac5d8c-4782-4fbd-b902-d55f609de1a1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:34.308919 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-22ac5d8c-4782-4fbd-b902-d55f609de1a1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:34.317389 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-22ac5d8c-4782-4fbd-b902-d55f609de1a1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1726 microversion: 2.1 time: 0.154736 Sep 25 04:39:34.317951 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 205/464] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:34 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:34.710454 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-53ec28fb-b52c-48fb-b502-4af062835a86 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a1f5b3d-cbb6-48a8-a71d-6a17ad8c853c"}} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:39:34.712866 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-53ec28fb-b52c-48fb-b502-4af062835a86 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:34.719653 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-53ec28fb-b52c-48fb-b502-4af062835a86 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:34.720137 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-53ec28fb-b52c-48fb-b502-4af062835a86 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:34.720572 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-53ec28fb-b52c-48fb-b502-4af062835a86 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:34.721288 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-53ec28fb-b52c-48fb-b502-4af062835a86 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:34.721742 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-53ec28fb-b52c-48fb-b502-4af062835a86 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:34.722166 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-53ec28fb-b52c-48fb-b502-4af062835a86 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:34.993214 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-53ec28fb-b52c-48fb-b502-4af062835a86 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "POST /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287115 Sep 25 04:39:34.994258 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 260/465] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Sep 25 04:39:34 2022] POST /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:39:35.343278 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-e57ed253-8e7a-4a53-b6a3-f3bfd6e9985e tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:35.343871 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-e57ed253-8e7a-4a53-b6a3-f3bfd6e9985e tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:35.350367 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e57ed253-8e7a-4a53-b6a3-f3bfd6e9985e tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:35.350851 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e57ed253-8e7a-4a53-b6a3-f3bfd6e9985e tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:35.351288 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e57ed253-8e7a-4a53-b6a3-f3bfd6e9985e tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:35.351969 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e57ed253-8e7a-4a53-b6a3-f3bfd6e9985e tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:35.352425 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e57ed253-8e7a-4a53-b6a3-f3bfd6e9985e tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:35.352879 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e57ed253-8e7a-4a53-b6a3-f3bfd6e9985e tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:35.483654 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-e57ed253-8e7a-4a53-b6a3-f3bfd6e9985e tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:35.492052 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-e57ed253-8e7a-4a53-b6a3-f3bfd6e9985e tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1726 microversion: 2.1 time: 0.153408 Sep 25 04:39:35.492617 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 206/466] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:35 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:36.516144 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-ec898c46-2a6f-4c7a-b643-78a387104790 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:36.516867 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-ec898c46-2a6f-4c7a-b643-78a387104790 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:36.523678 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ec898c46-2a6f-4c7a-b643-78a387104790 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:36.524163 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ec898c46-2a6f-4c7a-b643-78a387104790 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:36.524602 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ec898c46-2a6f-4c7a-b643-78a387104790 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:36.525311 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ec898c46-2a6f-4c7a-b643-78a387104790 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:36.525765 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ec898c46-2a6f-4c7a-b643-78a387104790 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:36.526192 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ec898c46-2a6f-4c7a-b643-78a387104790 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:36.660285 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-ec898c46-2a6f-4c7a-b643-78a387104790 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:36.668676 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-ec898c46-2a6f-4c7a-b643-78a387104790 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1726 microversion: 2.1 time: 0.156811 Sep 25 04:39:36.669246 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 261/467] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:36 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:37.692458 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-47b8391f-b422-4067-b91e-603678aeae23 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:37.693127 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-47b8391f-b422-4067-b91e-603678aeae23 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:37.699739 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-47b8391f-b422-4067-b91e-603678aeae23 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:37.700221 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-47b8391f-b422-4067-b91e-603678aeae23 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:37.700673 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-47b8391f-b422-4067-b91e-603678aeae23 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:37.702208 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-47b8391f-b422-4067-b91e-603678aeae23 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:37.702663 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-47b8391f-b422-4067-b91e-603678aeae23 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:37.703085 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-47b8391f-b422-4067-b91e-603678aeae23 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:37.833071 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-47b8391f-b422-4067-b91e-603678aeae23 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:37.841566 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-47b8391f-b422-4067-b91e-603678aeae23 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1726 microversion: 2.1 time: 0.152817 Sep 25 04:39:37.842239 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 207/468] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:37 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:38.866073 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-924f26da-f5c4-4695-a4a6-7738548a1030 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:38.866609 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-924f26da-f5c4-4695-a4a6-7738548a1030 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:38.873171 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-924f26da-f5c4-4695-a4a6-7738548a1030 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:38.873654 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-924f26da-f5c4-4695-a4a6-7738548a1030 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:38.874090 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-924f26da-f5c4-4695-a4a6-7738548a1030 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:38.874776 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-924f26da-f5c4-4695-a4a6-7738548a1030 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:38.875233 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-924f26da-f5c4-4695-a4a6-7738548a1030 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:38.875659 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-924f26da-f5c4-4695-a4a6-7738548a1030 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:39.004263 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-924f26da-f5c4-4695-a4a6-7738548a1030 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:39.012402 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-924f26da-f5c4-4695-a4a6-7738548a1030 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1726 microversion: 2.1 time: 0.150248 Sep 25 04:39:39.012998 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 262/469] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:38 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:40.036454 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-e5947e48-1f7c-43d3-9a81-27e678f59232 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:40.037099 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-e5947e48-1f7c-43d3-9a81-27e678f59232 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:40.043583 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e5947e48-1f7c-43d3-9a81-27e678f59232 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:40.044074 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e5947e48-1f7c-43d3-9a81-27e678f59232 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:40.044513 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e5947e48-1f7c-43d3-9a81-27e678f59232 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:40.046032 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e5947e48-1f7c-43d3-9a81-27e678f59232 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:40.046496 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e5947e48-1f7c-43d3-9a81-27e678f59232 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:40.046925 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e5947e48-1f7c-43d3-9a81-27e678f59232 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:40.179068 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-e5947e48-1f7c-43d3-9a81-27e678f59232 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:40.187589 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-e5947e48-1f7c-43d3-9a81-27e678f59232 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1726 microversion: 2.1 time: 0.154989 Sep 25 04:39:40.188143 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 208/470] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:40 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:41.212605 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-4103702e-1484-4668-86c5-d2151f703225 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:41.213246 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-4103702e-1484-4668-86c5-d2151f703225 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:41.220390 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4103702e-1484-4668-86c5-d2151f703225 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:41.220909 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4103702e-1484-4668-86c5-d2151f703225 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:41.221351 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4103702e-1484-4668-86c5-d2151f703225 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:41.222034 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4103702e-1484-4668-86c5-d2151f703225 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:41.222489 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4103702e-1484-4668-86c5-d2151f703225 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:41.222916 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4103702e-1484-4668-86c5-d2151f703225 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:41.355233 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-4103702e-1484-4668-86c5-d2151f703225 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:41.364242 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-4103702e-1484-4668-86c5-d2151f703225 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1726 microversion: 2.1 time: 0.155715 Sep 25 04:39:41.364824 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 263/471] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:41 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:42.387294 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-5bb5edb6-9fc4-464a-8ce9-5c43c3631514 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:42.387901 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-5bb5edb6-9fc4-464a-8ce9-5c43c3631514 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:42.394562 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5bb5edb6-9fc4-464a-8ce9-5c43c3631514 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:42.395048 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5bb5edb6-9fc4-464a-8ce9-5c43c3631514 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:42.395488 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5bb5edb6-9fc4-464a-8ce9-5c43c3631514 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:42.396181 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5bb5edb6-9fc4-464a-8ce9-5c43c3631514 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:42.396656 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5bb5edb6-9fc4-464a-8ce9-5c43c3631514 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:42.397104 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5bb5edb6-9fc4-464a-8ce9-5c43c3631514 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:42.535047 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-5bb5edb6-9fc4-464a-8ce9-5c43c3631514 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:42.543239 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-5bb5edb6-9fc4-464a-8ce9-5c43c3631514 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1726 microversion: 2.1 time: 0.159845 Sep 25 04:39:42.543794 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 209/472] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:42 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:43.569117 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-f1a9643b-50d5-46f2-b8ec-41fc98d1375c tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:43.569729 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-f1a9643b-50d5-46f2-b8ec-41fc98d1375c tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:43.572339 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell0:SELECT=2 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:39:43.579061 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f1a9643b-50d5-46f2-b8ec-41fc98d1375c tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:43.579550 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f1a9643b-50d5-46f2-b8ec-41fc98d1375c tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:43.580226 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f1a9643b-50d5-46f2-b8ec-41fc98d1375c tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:43.581269 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f1a9643b-50d5-46f2-b8ec-41fc98d1375c tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:43.581761 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f1a9643b-50d5-46f2-b8ec-41fc98d1375c tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:43.582519 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f1a9643b-50d5-46f2-b8ec-41fc98d1375c tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:43.682270 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-4ee66c28-c488-44fb-aac4-3f9b9d668e5b tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:43.682881 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-4ee66c28-c488-44fb-aac4-3f9b9d668e5b tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:43.689935 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4ee66c28-c488-44fb-aac4-3f9b9d668e5b tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:43.690435 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4ee66c28-c488-44fb-aac4-3f9b9d668e5b tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:43.690874 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4ee66c28-c488-44fb-aac4-3f9b9d668e5b tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:43.691589 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4ee66c28-c488-44fb-aac4-3f9b9d668e5b tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:43.692050 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4ee66c28-c488-44fb-aac4-3f9b9d668e5b tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:43.692478 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4ee66c28-c488-44fb-aac4-3f9b9d668e5b tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:44.022356 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-f1a9643b-50d5-46f2-b8ec-41fc98d1375c tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:44.026326 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-4ee66c28-c488-44fb-aac4-3f9b9d668e5b tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:44.031673 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-f1a9643b-50d5-46f2-b8ec-41fc98d1375c tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1726 microversion: 2.1 time: 0.467144 Sep 25 04:39:44.032725 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 264/473] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:43 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1726 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:44.035129 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-4ee66c28-c488-44fb-aac4-3f9b9d668e5b tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1594 microversion: 2.1 time: 0.356756 Sep 25 04:39:44.035694 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 210/474] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:43 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1594 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:39:45.055430 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-1b26920b-a4c2-43a3-9e54-39f26ac841e2 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:45.056072 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-1b26920b-a4c2-43a3-9e54-39f26ac841e2 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:45.062677 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1b26920b-a4c2-43a3-9e54-39f26ac841e2 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:45.063171 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1b26920b-a4c2-43a3-9e54-39f26ac841e2 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:45.063647 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1b26920b-a4c2-43a3-9e54-39f26ac841e2 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:45.064350 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1b26920b-a4c2-43a3-9e54-39f26ac841e2 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:45.065301 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1b26920b-a4c2-43a3-9e54-39f26ac841e2 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:45.065301 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1b26920b-a4c2-43a3-9e54-39f26ac841e2 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:45.196113 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-1b26920b-a4c2-43a3-9e54-39f26ac841e2 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:45.198609 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:39:45.206401 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-1b26920b-a4c2-43a3-9e54-39f26ac841e2 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1726 microversion: 2.1 time: 0.154875 Sep 25 04:39:45.206992 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 265/475] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:45 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:45.753045 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [req-3c2cef49-2920-44aa-8694-86473c909edf req-d0f77409-8142-4c8a-9ead-f40cdbc8221f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6582b313-e063-4d3f-940f-5ffba2370c65", "tag": "1a0b90ca-b310-46fa-adf6-563e2d00f49d"}]} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:39:45.763550 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-3c2cef49-2920-44aa-8694-86473c909edf req-d0f77409-8142-4c8a-9ead-f40cdbc8221f service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:45.764143 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-3c2cef49-2920-44aa-8694-86473c909edf req-d0f77409-8142-4c8a-9ead-f40cdbc8221f service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:45.764863 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-3c2cef49-2920-44aa-8694-86473c909edf req-d0f77409-8142-4c8a-9ead-f40cdbc8221f service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:45.777519 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.compute.server_external_events [req-3c2cef49-2920-44aa-8694-86473c909edf req-d0f77409-8142-4c8a-9ead-f40cdbc8221f service nova] Creating event network-changed:1a0b90ca-b310-46fa-adf6-563e2d00f49d for instance 6582b313-e063-4d3f-940f-5ffba2370c65 on hv-cinder-85535 Sep 25 04:39:45.784674 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [req-3c2cef49-2920-44aa-8694-86473c909edf req-d0f77409-8142-4c8a-9ead-f40cdbc8221f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034776 Sep 25 04:39:45.785697 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 211/476] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:39:46.235359 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-340d7712-7a92-4248-b34c-ef3622c65620 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:46.236167 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-340d7712-7a92-4248-b34c-ef3622c65620 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:46.244821 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-340d7712-7a92-4248-b34c-ef3622c65620 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:46.245624 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-340d7712-7a92-4248-b34c-ef3622c65620 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:46.246263 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-340d7712-7a92-4248-b34c-ef3622c65620 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:46.246971 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-340d7712-7a92-4248-b34c-ef3622c65620 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:46.247428 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-340d7712-7a92-4248-b34c-ef3622c65620 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:46.247848 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-340d7712-7a92-4248-b34c-ef3622c65620 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:46.505718 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-340d7712-7a92-4248-b34c-ef3622c65620 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:46.515707 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-340d7712-7a92-4248-b34c-ef3622c65620 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1726 microversion: 2.1 time: 0.284726 Sep 25 04:39:46.516516 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 266/477] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:46 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1726 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:46.990028 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-a0e0eaf4-1a49-40fb-9aa4-e1aea05756b4 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1307643562"}} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:39:46.990653 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-a0e0eaf4-1a49-40fb-9aa4-e1aea05756b4 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:46.997282 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a0e0eaf4-1a49-40fb-9aa4-e1aea05756b4 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:46.997779 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a0e0eaf4-1a49-40fb-9aa4-e1aea05756b4 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:46.998221 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a0e0eaf4-1a49-40fb-9aa4-e1aea05756b4 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:46.999841 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a0e0eaf4-1a49-40fb-9aa4-e1aea05756b4 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:47.000295 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a0e0eaf4-1a49-40fb-9aa4-e1aea05756b4 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:47.000753 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a0e0eaf4-1a49-40fb-9aa4-e1aea05756b4 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:47.128283 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.network.security_group_api [None req-a0e0eaf4-1a49-40fb-9aa4-e1aea05756b4 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Adding security group aef11ff3-9e6f-4a68-874c-ad911f0e761c to port 1a0b90ca-b310-46fa-adf6-563e2d00f49d Sep 25 04:39:47.440987 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-a0e0eaf4-1a49-40fb-9aa4-e1aea05756b4 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "POST /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65/action" status: 202 len: 0 microversion: 2.1 time: 0.455181 Sep 25 04:39:47.441801 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 212/478] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 25 04:39:46 2022] POST /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65/action => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 04:39:47.452357 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-5b81b137-0e98-4ba8-8800-f3bd51d74d61 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:47.454230 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-5b81b137-0e98-4ba8-8800-f3bd51d74d61 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:47.457194 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [req-8eecf7ba-bc6a-48c4-bdc4-5c6aac640955 req-539b9720-c6c2-40f2-bf17-7440572b9fcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6582b313-e063-4d3f-940f-5ffba2370c65", "tag": "1a0b90ca-b310-46fa-adf6-563e2d00f49d"}]} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:39:47.461399 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5b81b137-0e98-4ba8-8800-f3bd51d74d61 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:47.461824 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5b81b137-0e98-4ba8-8800-f3bd51d74d61 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:47.462257 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5b81b137-0e98-4ba8-8800-f3bd51d74d61 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:47.463133 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5b81b137-0e98-4ba8-8800-f3bd51d74d61 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:47.463751 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5b81b137-0e98-4ba8-8800-f3bd51d74d61 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:47.464351 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5b81b137-0e98-4ba8-8800-f3bd51d74d61 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:47.484911 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-8eecf7ba-bc6a-48c4-bdc4-5c6aac640955 req-539b9720-c6c2-40f2-bf17-7440572b9fcd service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:47.485417 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-8eecf7ba-bc6a-48c4-bdc4-5c6aac640955 req-539b9720-c6c2-40f2-bf17-7440572b9fcd service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:47.485856 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-8eecf7ba-bc6a-48c4-bdc4-5c6aac640955 req-539b9720-c6c2-40f2-bf17-7440572b9fcd service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:47.505187 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.compute.server_external_events [req-8eecf7ba-bc6a-48c4-bdc4-5c6aac640955 req-539b9720-c6c2-40f2-bf17-7440572b9fcd service nova] Creating event network-changed:1a0b90ca-b310-46fa-adf6-563e2d00f49d for instance 6582b313-e063-4d3f-940f-5ffba2370c65 on hv-cinder-85535 Sep 25 04:39:47.515472 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [req-8eecf7ba-bc6a-48c4-bdc4-5c6aac640955 req-539b9720-c6c2-40f2-bf17-7440572b9fcd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063202 Sep 25 04:39:47.516410 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 213/479] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:39:47.540829 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-0a0ab677-c8bb-46e1-9345-2e7d89106534 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:47.541854 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-0a0ab677-c8bb-46e1-9345-2e7d89106534 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:47.549835 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0a0ab677-c8bb-46e1-9345-2e7d89106534 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:47.550684 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0a0ab677-c8bb-46e1-9345-2e7d89106534 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:47.551335 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0a0ab677-c8bb-46e1-9345-2e7d89106534 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:47.552037 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0a0ab677-c8bb-46e1-9345-2e7d89106534 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:47.552695 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0a0ab677-c8bb-46e1-9345-2e7d89106534 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:47.553138 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0a0ab677-c8bb-46e1-9345-2e7d89106534 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:47.557626 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=100 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:39:47.716114 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-5b81b137-0e98-4ba8-8800-f3bd51d74d61 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:47.729722 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-5b81b137-0e98-4ba8-8800-f3bd51d74d61 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1760 microversion: 2.1 time: 0.283594 Sep 25 04:39:47.751555 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 267/480] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:47 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1760 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:47.771475 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-0a0ab677-c8bb-46e1-9345-2e7d89106534 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:47.782712 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-0a0ab677-c8bb-46e1-9345-2e7d89106534 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1726 microversion: 2.1 time: 0.246152 Sep 25 04:39:47.783596 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 214/481] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:47 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1726 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:39:48.807324 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-08628de4-ee34-45ef-bab1-31bb23bbfdaa tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:48.807934 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-08628de4-ee34-45ef-bab1-31bb23bbfdaa tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:48.814624 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-08628de4-ee34-45ef-bab1-31bb23bbfdaa tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:48.815112 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-08628de4-ee34-45ef-bab1-31bb23bbfdaa tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:48.815552 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-08628de4-ee34-45ef-bab1-31bb23bbfdaa tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:48.816245 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-08628de4-ee34-45ef-bab1-31bb23bbfdaa tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:48.816739 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-08628de4-ee34-45ef-bab1-31bb23bbfdaa tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:48.817173 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-08628de4-ee34-45ef-bab1-31bb23bbfdaa tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:48.945710 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-08628de4-ee34-45ef-bab1-31bb23bbfdaa tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:48.954419 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-08628de4-ee34-45ef-bab1-31bb23bbfdaa tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1726 microversion: 2.1 time: 0.150968 Sep 25 04:39:48.954990 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 268/482] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:48 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:49.977837 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-65a03f08-70f3-4be6-bef4-de0d71e313d9 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:49.978486 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-65a03f08-70f3-4be6-bef4-de0d71e313d9 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:49.984667 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-65a03f08-70f3-4be6-bef4-de0d71e313d9 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:49.985154 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-65a03f08-70f3-4be6-bef4-de0d71e313d9 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:49.985593 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-65a03f08-70f3-4be6-bef4-de0d71e313d9 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:49.986274 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-65a03f08-70f3-4be6-bef4-de0d71e313d9 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:49.986721 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-65a03f08-70f3-4be6-bef4-de0d71e313d9 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:49.987142 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-65a03f08-70f3-4be6-bef4-de0d71e313d9 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:50.114919 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-65a03f08-70f3-4be6-bef4-de0d71e313d9 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:50.123485 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-65a03f08-70f3-4be6-bef4-de0d71e313d9 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1703 microversion: 2.1 time: 0.149331 Sep 25 04:39:50.124053 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 215/483] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:49 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1703 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:50.146820 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-3f4cc094-0374-4f28-8849-d478945a3e5a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:39:50.153232 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3f4cc094-0374-4f28-8849-d478945a3e5a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:50.153724 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3f4cc094-0374-4f28-8849-d478945a3e5a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:50.154163 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3f4cc094-0374-4f28-8849-d478945a3e5a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:50.176860 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-3f4cc094-0374-4f28-8849-d478945a3e5a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Going to try to start instance {{(pid=127142) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 25 04:39:50.222051 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-3f4cc094-0374-4f28-8849-d478945a3e5a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "POST /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632/action" status: 202 len: 0 microversion: 2.1 time: 0.078863 Sep 25 04:39:50.222646 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 269/484] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 25 04:39:50 2022] POST /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 04:39:50.230819 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-d9a3d0ca-19d6-43bc-acd0-8a85fc796a47 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:50.231369 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-d9a3d0ca-19d6-43bc-acd0-8a85fc796a47 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:50.237355 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d9a3d0ca-19d6-43bc-acd0-8a85fc796a47 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:50.237952 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d9a3d0ca-19d6-43bc-acd0-8a85fc796a47 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:50.238402 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d9a3d0ca-19d6-43bc-acd0-8a85fc796a47 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:50.239194 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d9a3d0ca-19d6-43bc-acd0-8a85fc796a47 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:50.239660 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d9a3d0ca-19d6-43bc-acd0-8a85fc796a47 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:50.240089 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d9a3d0ca-19d6-43bc-acd0-8a85fc796a47 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:50.295926 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-e2b69bd9-0dd8-48f5-80c6-5774945eee44 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:50.296510 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-e2b69bd9-0dd8-48f5-80c6-5774945eee44 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:50.303300 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e2b69bd9-0dd8-48f5-80c6-5774945eee44 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:50.305012 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e2b69bd9-0dd8-48f5-80c6-5774945eee44 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:50.305408 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e2b69bd9-0dd8-48f5-80c6-5774945eee44 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:50.306146 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e2b69bd9-0dd8-48f5-80c6-5774945eee44 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:50.306857 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e2b69bd9-0dd8-48f5-80c6-5774945eee44 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:50.308059 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e2b69bd9-0dd8-48f5-80c6-5774945eee44 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:50.334518 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-e2b69bd9-0dd8-48f5-80c6-5774945eee44 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14/ips" status: 200 len: 152 microversion: 2.20 time: 0.042848 Sep 25 04:39:50.335625 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 270/485] 10.222.0.25 () {60 vars in 1289 bytes} [Sun Sep 25 04:39:50 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14/ips => generated 152 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 25 04:39:50.383110 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-d9a3d0ca-19d6-43bc-acd0-8a85fc796a47 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:50.392988 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-d9a3d0ca-19d6-43bc-acd0-8a85fc796a47 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1712 microversion: 2.1 time: 0.165909 Sep 25 04:39:50.393822 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 216/486] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:50 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1712 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:50.825349 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-cf02f9f4-14d9-46ec-a115-1c683955dc12 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:50.825847 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-cf02f9f4-14d9-46ec-a115-1c683955dc12 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:50.832183 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cf02f9f4-14d9-46ec-a115-1c683955dc12 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:50.832683 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cf02f9f4-14d9-46ec-a115-1c683955dc12 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:50.833118 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cf02f9f4-14d9-46ec-a115-1c683955dc12 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:50.833804 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cf02f9f4-14d9-46ec-a115-1c683955dc12 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:50.834251 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cf02f9f4-14d9-46ec-a115-1c683955dc12 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:50.834938 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cf02f9f4-14d9-46ec-a115-1c683955dc12 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:50.859007 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-cf02f9f4-14d9-46ec-a115-1c683955dc12 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1/ips" status: 200 len: 150 microversion: 2.1 time: 0.037314 Sep 25 04:39:50.859581 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 271/487] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Sep 25 04:39:50 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:39:51.417054 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-54294485-2ae7-4cd3-88f8-1a6901b67545 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:51.417697 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-54294485-2ae7-4cd3-88f8-1a6901b67545 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:51.424072 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-54294485-2ae7-4cd3-88f8-1a6901b67545 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:51.424560 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-54294485-2ae7-4cd3-88f8-1a6901b67545 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:51.425035 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-54294485-2ae7-4cd3-88f8-1a6901b67545 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:51.425729 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-54294485-2ae7-4cd3-88f8-1a6901b67545 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:51.426189 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-54294485-2ae7-4cd3-88f8-1a6901b67545 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:51.426619 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-54294485-2ae7-4cd3-88f8-1a6901b67545 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:51.605524 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-54294485-2ae7-4cd3-88f8-1a6901b67545 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:51.614078 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-54294485-2ae7-4cd3-88f8-1a6901b67545 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1712 microversion: 2.1 time: 0.200867 Sep 25 04:39:51.614637 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 217/488] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:51 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1712 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:52.636274 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-57326444-4ce2-4631-9b7d-d92cf574e709 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:52.636903 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-57326444-4ce2-4631-9b7d-d92cf574e709 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:52.643646 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-57326444-4ce2-4631-9b7d-d92cf574e709 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:52.644127 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-57326444-4ce2-4631-9b7d-d92cf574e709 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:52.644557 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-57326444-4ce2-4631-9b7d-d92cf574e709 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:52.645259 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-57326444-4ce2-4631-9b7d-d92cf574e709 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:52.645709 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-57326444-4ce2-4631-9b7d-d92cf574e709 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:52.646125 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-57326444-4ce2-4631-9b7d-d92cf574e709 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:52.787362 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-57326444-4ce2-4631-9b7d-d92cf574e709 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:52.796312 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-57326444-4ce2-4631-9b7d-d92cf574e709 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1712 microversion: 2.1 time: 0.163923 Sep 25 04:39:52.796902 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 272/489] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:52 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1712 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:53.292011 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-6c8eaa24-f37b-4985-b13f-2195f9b6f5f8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd9f3650-aa8a-4f8e-8412-cd5409e73a80"}} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:39:53.294765 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-6c8eaa24-f37b-4985-b13f-2195f9b6f5f8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:53.301396 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6c8eaa24-f37b-4985-b13f-2195f9b6f5f8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:53.301883 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6c8eaa24-f37b-4985-b13f-2195f9b6f5f8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:53.302390 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6c8eaa24-f37b-4985-b13f-2195f9b6f5f8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:53.303078 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6c8eaa24-f37b-4985-b13f-2195f9b6f5f8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:53.303531 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6c8eaa24-f37b-4985-b13f-2195f9b6f5f8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:53.303953 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6c8eaa24-f37b-4985-b13f-2195f9b6f5f8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:53.366393 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-1f0dc53d-6fa9-4832-adf1-5a206244d365 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:39:53.366927 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-1f0dc53d-6fa9-4832-adf1-5a206244d365 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:53.373635 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1f0dc53d-6fa9-4832-adf1-5a206244d365 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:53.374401 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1f0dc53d-6fa9-4832-adf1-5a206244d365 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:53.374659 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1f0dc53d-6fa9-4832-adf1-5a206244d365 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:53.375354 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1f0dc53d-6fa9-4832-adf1-5a206244d365 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:53.375813 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1f0dc53d-6fa9-4832-adf1-5a206244d365 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:53.376245 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1f0dc53d-6fa9-4832-adf1-5a206244d365 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:53.399200 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.objects.instance [None req-1f0dc53d-6fa9-4832-adf1-5a206244d365 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lazy-loading 'flavor' on Instance uuid c9e99419-ae76-4d84-9e7a-d0a31530ea14 {{(pid=127142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 04:39:53.580439 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-6c8eaa24-f37b-4985-b13f-2195f9b6f5f8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "POST /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292043 Sep 25 04:39:53.581270 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 218/490] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Sep 25 04:39:53 2022] POST /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:39:53.613096 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-1f0dc53d-6fa9-4832-adf1-5a206244d365 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "POST /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14/action" status: 202 len: 0 microversion: 2.20 time: 0.250405 Sep 25 04:39:53.613678 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 273/491] 10.222.0.25 () {62 vars in 1319 bytes} [Sun Sep 25 04:39:53 2022] POST /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 25 04:39:53.622792 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-68add731-a00a-48d0-9651-7fb60ddd994e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:53.624287 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-68add731-a00a-48d0-9651-7fb60ddd994e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:53.631346 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-68add731-a00a-48d0-9651-7fb60ddd994e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:53.632675 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-68add731-a00a-48d0-9651-7fb60ddd994e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:53.633137 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-68add731-a00a-48d0-9651-7fb60ddd994e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:53.634181 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-68add731-a00a-48d0-9651-7fb60ddd994e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:53.634640 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-68add731-a00a-48d0-9651-7fb60ddd994e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:53.635183 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-68add731-a00a-48d0-9651-7fb60ddd994e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:53.778744 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-68add731-a00a-48d0-9651-7fb60ddd994e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:53.787166 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-68add731-a00a-48d0-9651-7fb60ddd994e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:53.788614 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-68add731-a00a-48d0-9651-7fb60ddd994e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:53.789813 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-68add731-a00a-48d0-9651-7fb60ddd994e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1724 microversion: 2.20 time: 0.171648 Sep 25 04:39:53.790372 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 219/492] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:39:53 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:39:53.820622 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-683f2782-9660-4bb8-bd12-8903524405c0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:53.821380 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-683f2782-9660-4bb8-bd12-8903524405c0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:53.827969 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-683f2782-9660-4bb8-bd12-8903524405c0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:53.828443 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-683f2782-9660-4bb8-bd12-8903524405c0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:53.828915 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-683f2782-9660-4bb8-bd12-8903524405c0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:53.829593 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-683f2782-9660-4bb8-bd12-8903524405c0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:53.830040 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-683f2782-9660-4bb8-bd12-8903524405c0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:53.830457 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-683f2782-9660-4bb8-bd12-8903524405c0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:53.967893 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-683f2782-9660-4bb8-bd12-8903524405c0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:53.976672 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-683f2782-9660-4bb8-bd12-8903524405c0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1716 microversion: 2.1 time: 0.160641 Sep 25 04:39:53.977246 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 274/493] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:39:53 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1716 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:39:54.815951 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-99add531-612b-4cf6-ad21-83249a804ebf tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:54.816479 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-99add531-612b-4cf6-ad21-83249a804ebf tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:54.822832 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-99add531-612b-4cf6-ad21-83249a804ebf tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:54.823316 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-99add531-612b-4cf6-ad21-83249a804ebf tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:54.823745 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-99add531-612b-4cf6-ad21-83249a804ebf tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:54.824424 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-99add531-612b-4cf6-ad21-83249a804ebf tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:54.824929 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-99add531-612b-4cf6-ad21-83249a804ebf tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:54.825353 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-99add531-612b-4cf6-ad21-83249a804ebf tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:54.951983 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-99add531-612b-4cf6-ad21-83249a804ebf tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:54.960274 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-99add531-612b-4cf6-ad21-83249a804ebf tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:54.961762 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-99add531-612b-4cf6-ad21-83249a804ebf tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:54.962916 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-99add531-612b-4cf6-ad21-83249a804ebf tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1724 microversion: 2.20 time: 0.151381 Sep 25 04:39:54.963479 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 220/494] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:39:54 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 04:39:55.988502 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-8a632f53-ecc0-4702-9fca-7d1874d426e3 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:55.989109 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-8a632f53-ecc0-4702-9fca-7d1874d426e3 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:55.995570 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8a632f53-ecc0-4702-9fca-7d1874d426e3 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:55.996058 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8a632f53-ecc0-4702-9fca-7d1874d426e3 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:55.996503 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8a632f53-ecc0-4702-9fca-7d1874d426e3 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:55.997228 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8a632f53-ecc0-4702-9fca-7d1874d426e3 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:55.997691 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8a632f53-ecc0-4702-9fca-7d1874d426e3 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:55.998237 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8a632f53-ecc0-4702-9fca-7d1874d426e3 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:56.127987 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-8a632f53-ecc0-4702-9fca-7d1874d426e3 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:56.136055 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-8a632f53-ecc0-4702-9fca-7d1874d426e3 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:56.137538 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-8a632f53-ecc0-4702-9fca-7d1874d426e3 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:56.139280 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-8a632f53-ecc0-4702-9fca-7d1874d426e3 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1724 microversion: 2.20 time: 0.154205 Sep 25 04:39:56.139986 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 275/495] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:39:55 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:39:57.165268 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-c2fee48c-9d5a-4755-9c72-310282a71e4f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:57.165874 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-c2fee48c-9d5a-4755-9c72-310282a71e4f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:57.172662 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c2fee48c-9d5a-4755-9c72-310282a71e4f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:57.173157 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c2fee48c-9d5a-4755-9c72-310282a71e4f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:57.173590 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c2fee48c-9d5a-4755-9c72-310282a71e4f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:57.174270 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c2fee48c-9d5a-4755-9c72-310282a71e4f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:57.174723 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c2fee48c-9d5a-4755-9c72-310282a71e4f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:57.175146 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c2fee48c-9d5a-4755-9c72-310282a71e4f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:57.302818 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-c2fee48c-9d5a-4755-9c72-310282a71e4f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:57.311249 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-c2fee48c-9d5a-4755-9c72-310282a71e4f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:57.312712 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-c2fee48c-9d5a-4755-9c72-310282a71e4f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:57.313858 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-c2fee48c-9d5a-4755-9c72-310282a71e4f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1724 microversion: 2.20 time: 0.152560 Sep 25 04:39:57.314403 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 221/496] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:39:57 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:39:58.338543 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-cb354c5b-ab27-46e2-b826-157ffd820809 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:58.339144 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-cb354c5b-ab27-46e2-b826-157ffd820809 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:58.346470 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cb354c5b-ab27-46e2-b826-157ffd820809 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:58.346955 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cb354c5b-ab27-46e2-b826-157ffd820809 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:58.347388 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cb354c5b-ab27-46e2-b826-157ffd820809 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:58.348071 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cb354c5b-ab27-46e2-b826-157ffd820809 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:58.348524 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cb354c5b-ab27-46e2-b826-157ffd820809 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:58.349094 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cb354c5b-ab27-46e2-b826-157ffd820809 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:58.473669 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-cb354c5b-ab27-46e2-b826-157ffd820809 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:58.481863 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-cb354c5b-ab27-46e2-b826-157ffd820809 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:58.483575 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-cb354c5b-ab27-46e2-b826-157ffd820809 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:58.484748 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-cb354c5b-ab27-46e2-b826-157ffd820809 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1724 microversion: 2.20 time: 0.150308 Sep 25 04:39:58.485294 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 276/497] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:39:58 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:39:59.510411 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-4ab45abc-a4c4-4b36-b125-1ac11b8e3633 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:39:59.511041 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-4ab45abc-a4c4-4b36-b125-1ac11b8e3633 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:39:59.518343 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4ab45abc-a4c4-4b36-b125-1ac11b8e3633 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:59.518825 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4ab45abc-a4c4-4b36-b125-1ac11b8e3633 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:59.519260 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4ab45abc-a4c4-4b36-b125-1ac11b8e3633 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:59.519948 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4ab45abc-a4c4-4b36-b125-1ac11b8e3633 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:39:59.520401 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4ab45abc-a4c4-4b36-b125-1ac11b8e3633 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:39:59.520854 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4ab45abc-a4c4-4b36-b125-1ac11b8e3633 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:39:59.653175 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-4ab45abc-a4c4-4b36-b125-1ac11b8e3633 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:59.661247 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-4ab45abc-a4c4-4b36-b125-1ac11b8e3633 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:59.662715 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-4ab45abc-a4c4-4b36-b125-1ac11b8e3633 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:39:59.663862 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-4ab45abc-a4c4-4b36-b125-1ac11b8e3633 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1724 microversion: 2.20 time: 0.157370 Sep 25 04:39:59.664410 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 222/498] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:39:59 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:00.689754 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-9d646024-8304-4632-8430-60574819b95f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:00.690817 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-9d646024-8304-4632-8430-60574819b95f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:00.696856 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9d646024-8304-4632-8430-60574819b95f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:00.697356 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9d646024-8304-4632-8430-60574819b95f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:00.697780 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9d646024-8304-4632-8430-60574819b95f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:00.698456 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9d646024-8304-4632-8430-60574819b95f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:00.698901 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9d646024-8304-4632-8430-60574819b95f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:00.699317 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9d646024-8304-4632-8430-60574819b95f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:00.837576 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-9d646024-8304-4632-8430-60574819b95f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:00.846308 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-9d646024-8304-4632-8430-60574819b95f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:00.847739 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-9d646024-8304-4632-8430-60574819b95f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:00.848909 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-9d646024-8304-4632-8430-60574819b95f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1724 microversion: 2.20 time: 0.163589 Sep 25 04:40:00.849461 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 277/499] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:00 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:01.873825 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-09ed0642-410a-4934-97bf-bc64ceb33bef tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:01.874429 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-09ed0642-410a-4934-97bf-bc64ceb33bef tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:01.880915 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-09ed0642-410a-4934-97bf-bc64ceb33bef tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:01.881398 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-09ed0642-410a-4934-97bf-bc64ceb33bef tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:01.881835 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-09ed0642-410a-4934-97bf-bc64ceb33bef tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:01.882520 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-09ed0642-410a-4934-97bf-bc64ceb33bef tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:01.882973 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-09ed0642-410a-4934-97bf-bc64ceb33bef tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:01.883399 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-09ed0642-410a-4934-97bf-bc64ceb33bef tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:02.013254 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-09ed0642-410a-4934-97bf-bc64ceb33bef tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:02.022047 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-09ed0642-410a-4934-97bf-bc64ceb33bef tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:02.023485 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-09ed0642-410a-4934-97bf-bc64ceb33bef tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:02.024665 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-09ed0642-410a-4934-97bf-bc64ceb33bef tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1724 microversion: 2.20 time: 0.154773 Sep 25 04:40:02.025223 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 223/500] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:01 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:02.204492 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-c46de97b-580f-45fb-88b5-dcc198da47b5 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Action: 'create', calling method: .version_select at 0x7f4d3ed79550>, body: {"keypair": {"name": "tempest-keypair-1792938834", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrlHuwBew3qbbLNIhrE3yPVVzfth5wNuwECOvFOD/b4XebqZ4SHOolDGpIoNYJ4EvPAaZwdRFVodAI6z+UsCknx0+HObDpAt1WPAUvSz1s5yH8Qmv714o43Kt/V2Im/0A=="}} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:40:02.210520 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_api:SELECT=40 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:02.221779 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.quota [None req-c46de97b-580f-45fb-88b5-dcc198da47b5 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Getting quotas for project 5ead2221f7f54d6cbea9fc086a089342. Resources: {'key_pairs'} {{(pid=127142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 04:40:02.225542 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.quota [None req-c46de97b-580f-45fb-88b5-dcc198da47b5 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Getting quotas for user c50ba6f9a164463eae9a248936e7bf80 and project 5ead2221f7f54d6cbea9fc086a089342. Resources: {'key_pairs'} {{(pid=127142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 04:40:02.246505 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-c46de97b-580f-45fb-88b5-dcc198da47b5 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046657 Sep 25 04:40:02.247086 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 278/501] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 25 04:40:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:40:03.049880 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-4158fcdc-169b-4ded-b9c4-1a4057682679 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:03.050491 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-4158fcdc-169b-4ded-b9c4-1a4057682679 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:03.054020 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_api:SELECT=40 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:03.057685 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4158fcdc-169b-4ded-b9c4-1a4057682679 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:03.058168 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4158fcdc-169b-4ded-b9c4-1a4057682679 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:03.058604 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4158fcdc-169b-4ded-b9c4-1a4057682679 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:03.059294 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4158fcdc-169b-4ded-b9c4-1a4057682679 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:03.059748 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4158fcdc-169b-4ded-b9c4-1a4057682679 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:03.060174 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4158fcdc-169b-4ded-b9c4-1a4057682679 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:03.483552 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-4158fcdc-169b-4ded-b9c4-1a4057682679 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:03.491592 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-4158fcdc-169b-4ded-b9c4-1a4057682679 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:03.493059 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-4158fcdc-169b-4ded-b9c4-1a4057682679 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:03.494319 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-4158fcdc-169b-4ded-b9c4-1a4057682679 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1724 microversion: 2.20 time: 0.448402 Sep 25 04:40:03.494868 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 224/502] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:03 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1724 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:03.803339 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-450f1139-5597-4ebc-84d8-bf3e09b1bd73 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2126767135", "imageRef": "e5cfdbb2-d0ce-4736-b311-1a3c155844e9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4d931b43-9f4d-4494-b9d1-d242cc1f110c"}], "security_groups": [{"name": "tempest-securitygroup--1716550781"}], "key_name": "tempest-keypair-1792938834", "user_data": "}} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:40:03.907653 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.network.neutron [None req-450f1139-5597-4ebc-84d8-bf3e09b1bd73 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] validate_networks() for [('4d931b43-9f4d-4494-b9d1-d242cc1f110c', None, None, None, None, None)] {{(pid=127142) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 04:40:04.275669 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-450f1139-5597-4ebc-84d8-bf3e09b1bd73 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Flavor limits 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 04:40:04.276112 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-450f1139-5597-4ebc-84d8-bf3e09b1bd73 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Image limits 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 04:40:04.276579 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-450f1139-5597-4ebc-84d8-bf3e09b1bd73 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Flavor pref 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 04:40:04.277004 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-450f1139-5597-4ebc-84d8-bf3e09b1bd73 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Image pref 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 04:40:04.277409 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-450f1139-5597-4ebc-84d8-bf3e09b1bd73 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 04:40:04.286838 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-450f1139-5597-4ebc-84d8-bf3e09b1bd73 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:04.287309 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-450f1139-5597-4ebc-84d8-bf3e09b1bd73 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:04.287735 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-450f1139-5597-4ebc-84d8-bf3e09b1bd73 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:04.288443 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-450f1139-5597-4ebc-84d8-bf3e09b1bd73 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:04.288915 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-450f1139-5597-4ebc-84d8-bf3e09b1bd73 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:04.289334 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-450f1139-5597-4ebc-84d8-bf3e09b1bd73 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:04.305201 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.quota [None req-450f1139-5597-4ebc-84d8-bf3e09b1bd73 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Getting quotas for project 5ead2221f7f54d6cbea9fc086a089342. Resources: {'instances', 'ram', 'cores'} {{(pid=127142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 04:40:04.309144 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.quota [None req-450f1139-5597-4ebc-84d8-bf3e09b1bd73 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Getting quotas for user c50ba6f9a164463eae9a248936e7bf80 and project 5ead2221f7f54d6cbea9fc086a089342. Resources: {'instances', 'ram', 'cores'} {{(pid=127142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 04:40:04.319718 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-450f1139-5597-4ebc-84d8-bf3e09b1bd73 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Going to run 1 instances... {{(pid=127142) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 04:40:04.321998 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-450f1139-5597-4ebc-84d8-bf3e09b1bd73 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: e1e1377c-3c28-46cb-9832-cebf5ad33679] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5cfdbb2-d0ce-4736-b311-1a3c155844e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 04:40:04.372498 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-450f1139-5597-4ebc-84d8-bf3e09b1bd73 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.573992 Sep 25 04:40:04.376866 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 279/503] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 25 04:40:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 04:40:04.384514 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-80b4047d-9d08-4835-8c94-fd459cfb3a9a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:04.385153 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-80b4047d-9d08-4835-8c94-fd459cfb3a9a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: e1e1377c-3c28-46cb-9832-cebf5ad33679] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:04.439903 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-80b4047d-9d08-4835-8c94-fd459cfb3a9a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:04.446802 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-80b4047d-9d08-4835-8c94-fd459cfb3a9a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679" status: 200 len: 1242 microversion: 2.1 time: 0.066071 Sep 25 04:40:04.447369 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 225/504] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:40:04 2022] GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679 => generated 1242 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:40:04.519938 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-9b0f074b-1254-4358-b73c-859ac402fe23 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:04.520652 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-9b0f074b-1254-4358-b73c-859ac402fe23 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:04.527396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9b0f074b-1254-4358-b73c-859ac402fe23 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:04.527974 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9b0f074b-1254-4358-b73c-859ac402fe23 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:04.528416 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9b0f074b-1254-4358-b73c-859ac402fe23 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:04.529207 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9b0f074b-1254-4358-b73c-859ac402fe23 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:04.529777 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9b0f074b-1254-4358-b73c-859ac402fe23 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:04.530262 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9b0f074b-1254-4358-b73c-859ac402fe23 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:04.666559 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-9b0f074b-1254-4358-b73c-859ac402fe23 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:04.675758 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-9b0f074b-1254-4358-b73c-859ac402fe23 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:04.677353 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-9b0f074b-1254-4358-b73c-859ac402fe23 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:04.678518 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-9b0f074b-1254-4358-b73c-859ac402fe23 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1724 microversion: 2.20 time: 0.162608 Sep 25 04:40:04.679078 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 280/505] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:04 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:05.470584 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-0ba856f5-2457-49b1-b587-e49711d45af5 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:05.471198 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-0ba856f5-2457-49b1-b587-e49711d45af5 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: e1e1377c-3c28-46cb-9832-cebf5ad33679] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:05.478352 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0ba856f5-2457-49b1-b587-e49711d45af5 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:05.478843 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0ba856f5-2457-49b1-b587-e49711d45af5 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:05.479281 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0ba856f5-2457-49b1-b587-e49711d45af5 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:05.480003 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0ba856f5-2457-49b1-b587-e49711d45af5 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:05.480460 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0ba856f5-2457-49b1-b587-e49711d45af5 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:05.480917 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0ba856f5-2457-49b1-b587-e49711d45af5 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:05.543911 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-0ba856f5-2457-49b1-b587-e49711d45af5 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:05.552137 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-0ba856f5-2457-49b1-b587-e49711d45af5 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679" status: 200 len: 1294 microversion: 2.1 time: 0.085459 Sep 25 04:40:05.552713 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 226/506] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:40:05 2022] GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679 => generated 1294 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:40:05.704682 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-d84b90ab-6d02-4479-b1ec-8f40ee05afc5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:05.705288 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-d84b90ab-6d02-4479-b1ec-8f40ee05afc5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:05.712280 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d84b90ab-6d02-4479-b1ec-8f40ee05afc5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:05.712896 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d84b90ab-6d02-4479-b1ec-8f40ee05afc5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:05.713335 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d84b90ab-6d02-4479-b1ec-8f40ee05afc5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:05.714096 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d84b90ab-6d02-4479-b1ec-8f40ee05afc5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:05.715391 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d84b90ab-6d02-4479-b1ec-8f40ee05afc5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:05.715989 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d84b90ab-6d02-4479-b1ec-8f40ee05afc5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:05.853804 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-d84b90ab-6d02-4479-b1ec-8f40ee05afc5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:05.856009 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:05.864914 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-d84b90ab-6d02-4479-b1ec-8f40ee05afc5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:05.866352 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-d84b90ab-6d02-4479-b1ec-8f40ee05afc5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:05.867598 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-d84b90ab-6d02-4479-b1ec-8f40ee05afc5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1724 microversion: 2.20 time: 0.167414 Sep 25 04:40:05.868155 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 281/507] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:05 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:06.575145 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-e702800a-5c33-40e2-a857-743c7203b781 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:06.575793 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-e702800a-5c33-40e2-a857-743c7203b781 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: e1e1377c-3c28-46cb-9832-cebf5ad33679] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:06.582846 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e702800a-5c33-40e2-a857-743c7203b781 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:06.583271 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e702800a-5c33-40e2-a857-743c7203b781 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:06.583704 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e702800a-5c33-40e2-a857-743c7203b781 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:06.584395 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e702800a-5c33-40e2-a857-743c7203b781 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:06.585133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e702800a-5c33-40e2-a857-743c7203b781 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:06.585561 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e702800a-5c33-40e2-a857-743c7203b781 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:06.652344 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-e702800a-5c33-40e2-a857-743c7203b781 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:06.660540 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-e702800a-5c33-40e2-a857-743c7203b781 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679" status: 200 len: 1300 microversion: 2.1 time: 0.089365 Sep 25 04:40:06.661145 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 227/508] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:40:06 2022] GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679 => generated 1300 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:40:06.893582 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-f6a7dacd-19a4-4d5c-a099-e9063b9b52c7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:06.894317 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-f6a7dacd-19a4-4d5c-a099-e9063b9b52c7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:06.901979 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f6a7dacd-19a4-4d5c-a099-e9063b9b52c7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:06.902547 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f6a7dacd-19a4-4d5c-a099-e9063b9b52c7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:06.903044 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f6a7dacd-19a4-4d5c-a099-e9063b9b52c7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:06.903744 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f6a7dacd-19a4-4d5c-a099-e9063b9b52c7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:06.904782 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f6a7dacd-19a4-4d5c-a099-e9063b9b52c7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:06.905212 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f6a7dacd-19a4-4d5c-a099-e9063b9b52c7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:07.135454 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-f6a7dacd-19a4-4d5c-a099-e9063b9b52c7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:07.143651 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-f6a7dacd-19a4-4d5c-a099-e9063b9b52c7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:07.145135 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-f6a7dacd-19a4-4d5c-a099-e9063b9b52c7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:07.146297 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-f6a7dacd-19a4-4d5c-a099-e9063b9b52c7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1724 microversion: 2.20 time: 0.256711 Sep 25 04:40:07.146852 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 282/509] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:06 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:07.527422 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [req-0d6fa7b3-9c92-40c6-bb5f-3e55709256c8 req-b49ac0e5-0d92-4bf9-9137-5dacc24ebd9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1e1377c-3c28-46cb-9832-cebf5ad33679", "tag": "8d8f9d96-eeac-4835-8074-648560fb1d09"}]} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:40:07.537309 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-0d6fa7b3-9c92-40c6-bb5f-3e55709256c8 req-b49ac0e5-0d92-4bf9-9137-5dacc24ebd9a service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:07.537791 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-0d6fa7b3-9c92-40c6-bb5f-3e55709256c8 req-b49ac0e5-0d92-4bf9-9137-5dacc24ebd9a service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:07.538411 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-0d6fa7b3-9c92-40c6-bb5f-3e55709256c8 req-b49ac0e5-0d92-4bf9-9137-5dacc24ebd9a service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:07.559343 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.compute.server_external_events [req-0d6fa7b3-9c92-40c6-bb5f-3e55709256c8 req-b49ac0e5-0d92-4bf9-9137-5dacc24ebd9a service nova] Creating event network-changed:8d8f9d96-eeac-4835-8074-648560fb1d09 for instance e1e1377c-3c28-46cb-9832-cebf5ad33679 on hv-cinder-85535 Sep 25 04:40:07.566412 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [req-0d6fa7b3-9c92-40c6-bb5f-3e55709256c8 req-b49ac0e5-0d92-4bf9-9137-5dacc24ebd9a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042575 Sep 25 04:40:07.567292 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 228/510] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:40:07.684119 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-aeabc9be-d359-4a17-8582-1993fd07f61d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:07.684758 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-aeabc9be-d359-4a17-8582-1993fd07f61d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: e1e1377c-3c28-46cb-9832-cebf5ad33679] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:07.691690 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-aeabc9be-d359-4a17-8582-1993fd07f61d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:07.692325 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-aeabc9be-d359-4a17-8582-1993fd07f61d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:07.693024 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-aeabc9be-d359-4a17-8582-1993fd07f61d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:07.694324 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-aeabc9be-d359-4a17-8582-1993fd07f61d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:07.694882 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-aeabc9be-d359-4a17-8582-1993fd07f61d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:07.695574 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-aeabc9be-d359-4a17-8582-1993fd07f61d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:07.907883 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-aeabc9be-d359-4a17-8582-1993fd07f61d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:07.915389 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-aeabc9be-d359-4a17-8582-1993fd07f61d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679" status: 200 len: 1368 microversion: 2.1 time: 0.235657 Sep 25 04:40:07.916261 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 283/511] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:40:07 2022] GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679 => generated 1368 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:40:08.172261 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-69185943-1084-4276-bf3c-82bf92043d75 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:08.172983 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-69185943-1084-4276-bf3c-82bf92043d75 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:08.179615 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-69185943-1084-4276-bf3c-82bf92043d75 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:08.180094 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-69185943-1084-4276-bf3c-82bf92043d75 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:08.180530 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-69185943-1084-4276-bf3c-82bf92043d75 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:08.181246 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-69185943-1084-4276-bf3c-82bf92043d75 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:08.181701 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-69185943-1084-4276-bf3c-82bf92043d75 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:08.182125 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-69185943-1084-4276-bf3c-82bf92043d75 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:08.309089 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-69185943-1084-4276-bf3c-82bf92043d75 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:08.318068 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-69185943-1084-4276-bf3c-82bf92043d75 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:08.319498 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-69185943-1084-4276-bf3c-82bf92043d75 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:08.320655 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-69185943-1084-4276-bf3c-82bf92043d75 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1724 microversion: 2.20 time: 0.153024 Sep 25 04:40:08.321214 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 229/512] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:08 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:08.939772 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-8def987b-44f7-4bea-8f14-340f44fb722d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:08.940388 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-8def987b-44f7-4bea-8f14-340f44fb722d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: e1e1377c-3c28-46cb-9832-cebf5ad33679] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:08.947041 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8def987b-44f7-4bea-8f14-340f44fb722d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:08.947473 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8def987b-44f7-4bea-8f14-340f44fb722d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:08.947912 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8def987b-44f7-4bea-8f14-340f44fb722d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:08.948601 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8def987b-44f7-4bea-8f14-340f44fb722d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:08.949081 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8def987b-44f7-4bea-8f14-340f44fb722d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:08.949511 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8def987b-44f7-4bea-8f14-340f44fb722d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:09.079451 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-8def987b-44f7-4bea-8f14-340f44fb722d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:09.087362 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-8def987b-44f7-4bea-8f14-340f44fb722d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679" status: 200 len: 1368 microversion: 2.1 time: 0.152244 Sep 25 04:40:09.087930 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 284/513] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:40:08 2022] GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:40:09.346658 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-a7772fea-028e-4d7c-a17f-dc377f7e72c4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:09.347198 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-a7772fea-028e-4d7c-a17f-dc377f7e72c4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:09.353645 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a7772fea-028e-4d7c-a17f-dc377f7e72c4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:09.354124 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a7772fea-028e-4d7c-a17f-dc377f7e72c4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:09.354551 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a7772fea-028e-4d7c-a17f-dc377f7e72c4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:09.355231 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a7772fea-028e-4d7c-a17f-dc377f7e72c4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:09.355682 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a7772fea-028e-4d7c-a17f-dc377f7e72c4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:09.356103 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a7772fea-028e-4d7c-a17f-dc377f7e72c4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:09.486102 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-a7772fea-028e-4d7c-a17f-dc377f7e72c4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:09.494051 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-a7772fea-028e-4d7c-a17f-dc377f7e72c4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:09.495516 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-a7772fea-028e-4d7c-a17f-dc377f7e72c4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:09.496673 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-a7772fea-028e-4d7c-a17f-dc377f7e72c4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1724 microversion: 2.20 time: 0.154285 Sep 25 04:40:09.497220 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 230/514] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:09 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:10.110338 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-563b61bb-5e94-4dad-abc5-933d3cae12f9 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:10.110946 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-563b61bb-5e94-4dad-abc5-933d3cae12f9 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: e1e1377c-3c28-46cb-9832-cebf5ad33679] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:10.117467 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-563b61bb-5e94-4dad-abc5-933d3cae12f9 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:10.117951 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-563b61bb-5e94-4dad-abc5-933d3cae12f9 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:10.118382 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-563b61bb-5e94-4dad-abc5-933d3cae12f9 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:10.119066 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-563b61bb-5e94-4dad-abc5-933d3cae12f9 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:10.119519 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-563b61bb-5e94-4dad-abc5-933d3cae12f9 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:10.119940 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-563b61bb-5e94-4dad-abc5-933d3cae12f9 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:10.247645 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-563b61bb-5e94-4dad-abc5-933d3cae12f9 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:10.255134 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-563b61bb-5e94-4dad-abc5-933d3cae12f9 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679" status: 200 len: 1368 microversion: 2.1 time: 0.148852 Sep 25 04:40:10.255688 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 285/515] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:40:10 2022] GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:40:10.522692 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-31b65d8e-058d-4b4e-8657-b0eb7d72555b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:10.523224 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-31b65d8e-058d-4b4e-8657-b0eb7d72555b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:10.529992 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-31b65d8e-058d-4b4e-8657-b0eb7d72555b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:10.530453 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-31b65d8e-058d-4b4e-8657-b0eb7d72555b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:10.530889 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-31b65d8e-058d-4b4e-8657-b0eb7d72555b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:10.531569 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-31b65d8e-058d-4b4e-8657-b0eb7d72555b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:10.532019 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-31b65d8e-058d-4b4e-8657-b0eb7d72555b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:10.532436 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-31b65d8e-058d-4b4e-8657-b0eb7d72555b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:10.535097 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:10.664156 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-31b65d8e-058d-4b4e-8657-b0eb7d72555b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:10.672144 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-31b65d8e-058d-4b4e-8657-b0eb7d72555b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:10.673604 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-31b65d8e-058d-4b4e-8657-b0eb7d72555b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:10.674751 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-31b65d8e-058d-4b4e-8657-b0eb7d72555b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1724 microversion: 2.20 time: 0.156063 Sep 25 04:40:10.675569 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 231/516] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:10 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:11.278573 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-1b8ddafc-c3dc-4d0f-b89a-30cc8fc77661 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:11.279200 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-1b8ddafc-c3dc-4d0f-b89a-30cc8fc77661 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: e1e1377c-3c28-46cb-9832-cebf5ad33679] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:11.285605 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1b8ddafc-c3dc-4d0f-b89a-30cc8fc77661 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:11.286064 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1b8ddafc-c3dc-4d0f-b89a-30cc8fc77661 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:11.286490 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1b8ddafc-c3dc-4d0f-b89a-30cc8fc77661 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:11.287163 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1b8ddafc-c3dc-4d0f-b89a-30cc8fc77661 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:11.287611 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1b8ddafc-c3dc-4d0f-b89a-30cc8fc77661 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:11.288049 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1b8ddafc-c3dc-4d0f-b89a-30cc8fc77661 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:11.413815 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-1b8ddafc-c3dc-4d0f-b89a-30cc8fc77661 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:11.421685 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-1b8ddafc-c3dc-4d0f-b89a-30cc8fc77661 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679" status: 200 len: 1368 microversion: 2.1 time: 0.146892 Sep 25 04:40:11.422475 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 286/517] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:40:11 2022] GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:40:11.700217 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-d7b1e93b-c254-4c0a-be7d-9845fdbfc4ad tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:11.701885 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-d7b1e93b-c254-4c0a-be7d-9845fdbfc4ad tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:11.708296 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d7b1e93b-c254-4c0a-be7d-9845fdbfc4ad tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:11.708813 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d7b1e93b-c254-4c0a-be7d-9845fdbfc4ad tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:11.709250 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d7b1e93b-c254-4c0a-be7d-9845fdbfc4ad tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:11.710207 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d7b1e93b-c254-4c0a-be7d-9845fdbfc4ad tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:11.710655 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d7b1e93b-c254-4c0a-be7d-9845fdbfc4ad tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:11.711072 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d7b1e93b-c254-4c0a-be7d-9845fdbfc4ad tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:11.933141 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-d7b1e93b-c254-4c0a-be7d-9845fdbfc4ad tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:11.941376 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-d7b1e93b-c254-4c0a-be7d-9845fdbfc4ad tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:11.942860 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-d7b1e93b-c254-4c0a-be7d-9845fdbfc4ad tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:11.944411 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-d7b1e93b-c254-4c0a-be7d-9845fdbfc4ad tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1724 microversion: 2.20 time: 0.248117 Sep 25 04:40:11.945003 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 232/518] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:11 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:12.445286 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-f8053b53-e308-4572-81a4-36b1d6551cd2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:12.445896 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-f8053b53-e308-4572-81a4-36b1d6551cd2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: e1e1377c-3c28-46cb-9832-cebf5ad33679] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:12.452629 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f8053b53-e308-4572-81a4-36b1d6551cd2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:12.453145 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f8053b53-e308-4572-81a4-36b1d6551cd2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:12.453579 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f8053b53-e308-4572-81a4-36b1d6551cd2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:12.454269 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f8053b53-e308-4572-81a4-36b1d6551cd2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:12.454717 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f8053b53-e308-4572-81a4-36b1d6551cd2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:12.455137 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f8053b53-e308-4572-81a4-36b1d6551cd2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:12.589236 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-f8053b53-e308-4572-81a4-36b1d6551cd2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:12.596872 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-f8053b53-e308-4572-81a4-36b1d6551cd2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679" status: 200 len: 1368 microversion: 2.1 time: 0.155432 Sep 25 04:40:12.597433 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 287/519] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:40:12 2022] GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:40:12.970391 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-33c4b7ea-1170-41e3-b65e-3a1a30a4a493 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:12.971004 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-33c4b7ea-1170-41e3-b65e-3a1a30a4a493 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:12.977453 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-33c4b7ea-1170-41e3-b65e-3a1a30a4a493 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:12.977946 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-33c4b7ea-1170-41e3-b65e-3a1a30a4a493 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:12.978392 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-33c4b7ea-1170-41e3-b65e-3a1a30a4a493 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:12.979083 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-33c4b7ea-1170-41e3-b65e-3a1a30a4a493 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:12.979541 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-33c4b7ea-1170-41e3-b65e-3a1a30a4a493 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:12.979972 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-33c4b7ea-1170-41e3-b65e-3a1a30a4a493 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:13.105688 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-33c4b7ea-1170-41e3-b65e-3a1a30a4a493 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:13.113884 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-33c4b7ea-1170-41e3-b65e-3a1a30a4a493 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:13.115419 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-33c4b7ea-1170-41e3-b65e-3a1a30a4a493 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:13.116593 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-33c4b7ea-1170-41e3-b65e-3a1a30a4a493 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1724 microversion: 2.20 time: 0.150684 Sep 25 04:40:13.117165 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 233/520] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:12 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:13.620144 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-d4d62f47-701d-472a-b886-4894d9c64a40 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:13.620902 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-d4d62f47-701d-472a-b886-4894d9c64a40 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: e1e1377c-3c28-46cb-9832-cebf5ad33679] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:13.627775 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d4d62f47-701d-472a-b886-4894d9c64a40 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:13.628263 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d4d62f47-701d-472a-b886-4894d9c64a40 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:13.628730 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d4d62f47-701d-472a-b886-4894d9c64a40 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:13.629427 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d4d62f47-701d-472a-b886-4894d9c64a40 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:13.629918 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d4d62f47-701d-472a-b886-4894d9c64a40 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:13.630472 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d4d62f47-701d-472a-b886-4894d9c64a40 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:13.762356 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-d4d62f47-701d-472a-b886-4894d9c64a40 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:13.770122 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-d4d62f47-701d-472a-b886-4894d9c64a40 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679" status: 200 len: 1368 microversion: 2.1 time: 0.153951 Sep 25 04:40:13.770688 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 288/521] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:40:13 2022] GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:40:14.143170 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-60b38c00-ea30-4d39-89e1-94818f588ce8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:14.143818 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-60b38c00-ea30-4d39-89e1-94818f588ce8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:14.150267 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-60b38c00-ea30-4d39-89e1-94818f588ce8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:14.150745 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-60b38c00-ea30-4d39-89e1-94818f588ce8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:14.151176 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-60b38c00-ea30-4d39-89e1-94818f588ce8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:14.151857 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-60b38c00-ea30-4d39-89e1-94818f588ce8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:14.152307 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-60b38c00-ea30-4d39-89e1-94818f588ce8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:14.152750 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-60b38c00-ea30-4d39-89e1-94818f588ce8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:14.279739 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-60b38c00-ea30-4d39-89e1-94818f588ce8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:14.287763 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-60b38c00-ea30-4d39-89e1-94818f588ce8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:14.289242 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-60b38c00-ea30-4d39-89e1-94818f588ce8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:14.290398 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-60b38c00-ea30-4d39-89e1-94818f588ce8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1745 microversion: 2.20 time: 0.152539 Sep 25 04:40:14.290953 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 234/522] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:14 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:14.795629 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-9cb25031-7f23-4d31-8f8b-d6c0c6e914a8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:14.796273 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-9cb25031-7f23-4d31-8f8b-d6c0c6e914a8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: e1e1377c-3c28-46cb-9832-cebf5ad33679] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:14.798185 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell0:SELECT=2 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:14.798836 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell0:SELECT=10 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:14.805157 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9cb25031-7f23-4d31-8f8b-d6c0c6e914a8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:14.805642 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9cb25031-7f23-4d31-8f8b-d6c0c6e914a8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:14.806079 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9cb25031-7f23-4d31-8f8b-d6c0c6e914a8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:14.806761 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9cb25031-7f23-4d31-8f8b-d6c0c6e914a8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:14.807214 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9cb25031-7f23-4d31-8f8b-d6c0c6e914a8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:14.807639 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9cb25031-7f23-4d31-8f8b-d6c0c6e914a8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:14.945485 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-9cb25031-7f23-4d31-8f8b-d6c0c6e914a8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:14.953213 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-9cb25031-7f23-4d31-8f8b-d6c0c6e914a8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679" status: 200 len: 1368 microversion: 2.1 time: 0.162122 Sep 25 04:40:14.953768 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 289/523] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:40:14 2022] GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:40:15.249240 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [req-53974337-02f0-4ca6-8431-b3e5df7d2d24 req-7b62b7b3-cdc7-498c-a007-1a277597c993 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1e1377c-3c28-46cb-9832-cebf5ad33679", "name": "network-vif-plugged", "status": "completed", "tag": "8d8f9d96-eeac-4835-8074-648560fb1d09"}]} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:40:15.254106 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell0:SELECT=2 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:15.260297 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-53974337-02f0-4ca6-8431-b3e5df7d2d24 req-7b62b7b3-cdc7-498c-a007-1a277597c993 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:15.260810 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-53974337-02f0-4ca6-8431-b3e5df7d2d24 req-7b62b7b3-cdc7-498c-a007-1a277597c993 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:15.261237 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-53974337-02f0-4ca6-8431-b3e5df7d2d24 req-7b62b7b3-cdc7-498c-a007-1a277597c993 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:15.272422 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.compute.server_external_events [req-53974337-02f0-4ca6-8431-b3e5df7d2d24 req-7b62b7b3-cdc7-498c-a007-1a277597c993 service nova] Creating event network-vif-plugged:8d8f9d96-eeac-4835-8074-648560fb1d09 for instance e1e1377c-3c28-46cb-9832-cebf5ad33679 on hv-cinder-85535 Sep 25 04:40:15.277287 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [req-53974337-02f0-4ca6-8431-b3e5df7d2d24 req-7b62b7b3-cdc7-498c-a007-1a277597c993 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031729 Sep 25 04:40:15.277875 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 235/524] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:40:15.315813 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-d930531d-1a61-4395-a4dd-04134a52ba3c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:15.316422 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-d930531d-1a61-4395-a4dd-04134a52ba3c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:15.322439 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d930531d-1a61-4395-a4dd-04134a52ba3c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:15.322921 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d930531d-1a61-4395-a4dd-04134a52ba3c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:15.323349 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d930531d-1a61-4395-a4dd-04134a52ba3c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:15.324028 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d930531d-1a61-4395-a4dd-04134a52ba3c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:15.324473 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d930531d-1a61-4395-a4dd-04134a52ba3c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:15.324939 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d930531d-1a61-4395-a4dd-04134a52ba3c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:15.456657 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-d930531d-1a61-4395-a4dd-04134a52ba3c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:15.465140 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-d930531d-1a61-4395-a4dd-04134a52ba3c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:15.467231 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-d930531d-1a61-4395-a4dd-04134a52ba3c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:15.468401 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-d930531d-1a61-4395-a4dd-04134a52ba3c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1745 microversion: 2.20 time: 0.156654 Sep 25 04:40:15.468989 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 290/525] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:15 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:15.977157 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-961cd097-5bc1-4847-affb-0d565032e221 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:15.977889 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-961cd097-5bc1-4847-affb-0d565032e221 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: e1e1377c-3c28-46cb-9832-cebf5ad33679] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:15.984313 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-961cd097-5bc1-4847-affb-0d565032e221 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:15.984829 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-961cd097-5bc1-4847-affb-0d565032e221 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:15.985268 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-961cd097-5bc1-4847-affb-0d565032e221 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:15.985950 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-961cd097-5bc1-4847-affb-0d565032e221 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:15.986405 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-961cd097-5bc1-4847-affb-0d565032e221 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:15.986829 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-961cd097-5bc1-4847-affb-0d565032e221 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:16.114799 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-961cd097-5bc1-4847-affb-0d565032e221 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:16.122341 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-961cd097-5bc1-4847-affb-0d565032e221 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679" status: 200 len: 1368 microversion: 2.1 time: 0.149474 Sep 25 04:40:16.123933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 236/526] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:40:15 2022] GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:40:16.493794 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-913a917e-66d7-4f4f-8aea-ea533f5ec2e6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:16.494398 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-913a917e-66d7-4f4f-8aea-ea533f5ec2e6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:16.501132 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-913a917e-66d7-4f4f-8aea-ea533f5ec2e6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:16.501609 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-913a917e-66d7-4f4f-8aea-ea533f5ec2e6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:16.502035 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-913a917e-66d7-4f4f-8aea-ea533f5ec2e6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:16.502710 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-913a917e-66d7-4f4f-8aea-ea533f5ec2e6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:16.503157 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-913a917e-66d7-4f4f-8aea-ea533f5ec2e6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:16.503575 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-913a917e-66d7-4f4f-8aea-ea533f5ec2e6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:16.631573 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-913a917e-66d7-4f4f-8aea-ea533f5ec2e6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:16.639812 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-913a917e-66d7-4f4f-8aea-ea533f5ec2e6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:16.641284 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-913a917e-66d7-4f4f-8aea-ea533f5ec2e6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:16.642445 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-913a917e-66d7-4f4f-8aea-ea533f5ec2e6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1745 microversion: 2.20 time: 0.152574 Sep 25 04:40:16.643001 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 291/527] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:16 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:17.146329 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-c1e1e33e-df73-411d-b897-d9c537470105 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:17.146962 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-c1e1e33e-df73-411d-b897-d9c537470105 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: e1e1377c-3c28-46cb-9832-cebf5ad33679] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:17.153352 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c1e1e33e-df73-411d-b897-d9c537470105 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:17.154322 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c1e1e33e-df73-411d-b897-d9c537470105 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:17.154995 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c1e1e33e-df73-411d-b897-d9c537470105 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:17.155766 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c1e1e33e-df73-411d-b897-d9c537470105 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:17.156220 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c1e1e33e-df73-411d-b897-d9c537470105 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:17.156652 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c1e1e33e-df73-411d-b897-d9c537470105 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:17.296516 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-c1e1e33e-df73-411d-b897-d9c537470105 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:17.304376 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-c1e1e33e-df73-411d-b897-d9c537470105 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679" status: 200 len: 1368 microversion: 2.1 time: 0.161930 Sep 25 04:40:17.304982 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 237/528] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:40:17 2022] GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:40:17.668198 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-a9268f69-fe37-4fd3-869c-2f0b43d13687 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:17.668859 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-a9268f69-fe37-4fd3-869c-2f0b43d13687 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:17.675651 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a9268f69-fe37-4fd3-869c-2f0b43d13687 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:17.676130 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a9268f69-fe37-4fd3-869c-2f0b43d13687 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:17.676564 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a9268f69-fe37-4fd3-869c-2f0b43d13687 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:17.677273 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a9268f69-fe37-4fd3-869c-2f0b43d13687 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:17.677729 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a9268f69-fe37-4fd3-869c-2f0b43d13687 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:17.678152 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a9268f69-fe37-4fd3-869c-2f0b43d13687 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:17.806680 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-a9268f69-fe37-4fd3-869c-2f0b43d13687 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:17.815102 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-a9268f69-fe37-4fd3-869c-2f0b43d13687 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:17.816540 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-a9268f69-fe37-4fd3-869c-2f0b43d13687 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:17.817721 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-a9268f69-fe37-4fd3-869c-2f0b43d13687 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1745 microversion: 2.20 time: 0.153501 Sep 25 04:40:17.818315 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 292/529] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:17 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:18.327438 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-6a663f0c-b01a-4fbb-9bbc-3dedcc82471e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:18.328030 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-6a663f0c-b01a-4fbb-9bbc-3dedcc82471e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: e1e1377c-3c28-46cb-9832-cebf5ad33679] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:18.334415 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6a663f0c-b01a-4fbb-9bbc-3dedcc82471e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:18.334891 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6a663f0c-b01a-4fbb-9bbc-3dedcc82471e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:18.335587 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6a663f0c-b01a-4fbb-9bbc-3dedcc82471e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:18.336263 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6a663f0c-b01a-4fbb-9bbc-3dedcc82471e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:18.336734 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6a663f0c-b01a-4fbb-9bbc-3dedcc82471e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:18.337155 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6a663f0c-b01a-4fbb-9bbc-3dedcc82471e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:18.465709 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-6a663f0c-b01a-4fbb-9bbc-3dedcc82471e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:18.473738 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-6a663f0c-b01a-4fbb-9bbc-3dedcc82471e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679" status: 200 len: 1558 microversion: 2.1 time: 0.150440 Sep 25 04:40:18.474300 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 238/530] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:40:18 2022] GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:40:18.496609 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-77420ea1-34ac-4368-adb1-b5203559097b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:18.497118 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-77420ea1-34ac-4368-adb1-b5203559097b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: e1e1377c-3c28-46cb-9832-cebf5ad33679] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:18.504011 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-77420ea1-34ac-4368-adb1-b5203559097b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:18.504494 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-77420ea1-34ac-4368-adb1-b5203559097b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:18.504953 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-77420ea1-34ac-4368-adb1-b5203559097b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:18.505639 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-77420ea1-34ac-4368-adb1-b5203559097b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:18.506089 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-77420ea1-34ac-4368-adb1-b5203559097b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:18.506509 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-77420ea1-34ac-4368-adb1-b5203559097b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:18.584390 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-77420ea1-34ac-4368-adb1-b5203559097b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091573 Sep 25 04:40:18.585273 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 293/531] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Sep 25 04:40:18 2022] GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:40:18.845147 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-f724cc95-cd0e-4f32-81f7-3ff5871098b4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:18.845666 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-f724cc95-cd0e-4f32-81f7-3ff5871098b4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:18.851791 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f724cc95-cd0e-4f32-81f7-3ff5871098b4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:18.852277 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f724cc95-cd0e-4f32-81f7-3ff5871098b4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:18.852740 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f724cc95-cd0e-4f32-81f7-3ff5871098b4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:18.853441 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f724cc95-cd0e-4f32-81f7-3ff5871098b4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:18.853893 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f724cc95-cd0e-4f32-81f7-3ff5871098b4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:18.854311 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f724cc95-cd0e-4f32-81f7-3ff5871098b4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:19.213552 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-f724cc95-cd0e-4f32-81f7-3ff5871098b4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:19.222902 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-f724cc95-cd0e-4f32-81f7-3ff5871098b4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:19.224665 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-f724cc95-cd0e-4f32-81f7-3ff5871098b4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:19.226375 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-f724cc95-cd0e-4f32-81f7-3ff5871098b4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1745 microversion: 2.20 time: 0.386093 Sep 25 04:40:19.226945 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 239/532] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:18 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1745 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:19.227249 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-1e7ca4b3-8f2c-4152-9b36-0b905ac28acd req-f3ed443d-73b5-42a0-91f7-24076f4251b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9e99419-ae76-4d84-9e7a-d0a31530ea14", "name": "network-vif-plugged", "status": "completed", "tag": "28807ae7-bb46-4e31-93d7-48170864edca"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:40:19.239809 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-1e7ca4b3-8f2c-4152-9b36-0b905ac28acd req-f3ed443d-73b5-42a0-91f7-24076f4251b2 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:19.240474 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-1e7ca4b3-8f2c-4152-9b36-0b905ac28acd req-f3ed443d-73b5-42a0-91f7-24076f4251b2 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:19.241318 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-1e7ca4b3-8f2c-4152-9b36-0b905ac28acd req-f3ed443d-73b5-42a0-91f7-24076f4251b2 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:19.255003 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-1e7ca4b3-8f2c-4152-9b36-0b905ac28acd req-f3ed443d-73b5-42a0-91f7-24076f4251b2 service nova] Creating event network-vif-plugged:28807ae7-bb46-4e31-93d7-48170864edca for instance c9e99419-ae76-4d84-9e7a-d0a31530ea14 on hv-cinder-85535 Sep 25 04:40:19.262584 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-1e7ca4b3-8f2c-4152-9b36-0b905ac28acd req-f3ed443d-73b5-42a0-91f7-24076f4251b2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043171 Sep 25 04:40:19.264466 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 294/533] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:40:19.811391 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [req-c6a24a1b-5db6-4eb5-a653-bd3837e3c005 req-008b937e-9a03-431e-a216-6f64673ade46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1e1377c-3c28-46cb-9832-cebf5ad33679", "tag": "8d8f9d96-eeac-4835-8074-648560fb1d09"}]} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:40:19.821351 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-c6a24a1b-5db6-4eb5-a653-bd3837e3c005 req-008b937e-9a03-431e-a216-6f64673ade46 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:19.821900 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-c6a24a1b-5db6-4eb5-a653-bd3837e3c005 req-008b937e-9a03-431e-a216-6f64673ade46 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:19.822427 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-c6a24a1b-5db6-4eb5-a653-bd3837e3c005 req-008b937e-9a03-431e-a216-6f64673ade46 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:19.833851 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.compute.server_external_events [req-c6a24a1b-5db6-4eb5-a653-bd3837e3c005 req-008b937e-9a03-431e-a216-6f64673ade46 service nova] Creating event network-changed:8d8f9d96-eeac-4835-8074-648560fb1d09 for instance e1e1377c-3c28-46cb-9832-cebf5ad33679 on hv-cinder-85535 Sep 25 04:40:19.839323 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [req-c6a24a1b-5db6-4eb5-a653-bd3837e3c005 req-008b937e-9a03-431e-a216-6f64673ade46 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032181 Sep 25 04:40:19.840224 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 240/534] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:40:20.253140 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-64d383c5-db13-41ec-aecd-0a77cb063f74 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:20.253831 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-64d383c5-db13-41ec-aecd-0a77cb063f74 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:20.260632 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-64d383c5-db13-41ec-aecd-0a77cb063f74 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:20.261151 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-64d383c5-db13-41ec-aecd-0a77cb063f74 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:20.261588 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-64d383c5-db13-41ec-aecd-0a77cb063f74 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:20.262274 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-64d383c5-db13-41ec-aecd-0a77cb063f74 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:20.262722 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-64d383c5-db13-41ec-aecd-0a77cb063f74 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:20.263163 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-64d383c5-db13-41ec-aecd-0a77cb063f74 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:20.476824 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-64d383c5-db13-41ec-aecd-0a77cb063f74 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:20.486419 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-64d383c5-db13-41ec-aecd-0a77cb063f74 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:20.487909 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-64d383c5-db13-41ec-aecd-0a77cb063f74 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:20.489114 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-64d383c5-db13-41ec-aecd-0a77cb063f74 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1745 microversion: 2.20 time: 0.240242 Sep 25 04:40:20.489863 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 295/535] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:20 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1745 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:21.516317 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-61534afa-49f3-47b0-abd5-c0d8c9b0c6da tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:21.517030 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-61534afa-49f3-47b0-abd5-c0d8c9b0c6da tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:21.524162 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-61534afa-49f3-47b0-abd5-c0d8c9b0c6da tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:21.524667 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-61534afa-49f3-47b0-abd5-c0d8c9b0c6da tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:21.525110 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-61534afa-49f3-47b0-abd5-c0d8c9b0c6da tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:21.525792 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-61534afa-49f3-47b0-abd5-c0d8c9b0c6da tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:21.526245 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-61534afa-49f3-47b0-abd5-c0d8c9b0c6da tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:21.526665 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-61534afa-49f3-47b0-abd5-c0d8c9b0c6da tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:21.656816 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-61534afa-49f3-47b0-abd5-c0d8c9b0c6da tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:21.664820 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-61534afa-49f3-47b0-abd5-c0d8c9b0c6da tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:21.666260 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-61534afa-49f3-47b0-abd5-c0d8c9b0c6da tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:21.667403 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-61534afa-49f3-47b0-abd5-c0d8c9b0c6da tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1745 microversion: 2.20 time: 0.157081 Sep 25 04:40:21.667953 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 241/536] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:21 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:22.692893 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-98e8a49c-9a9b-42bb-b64c-4752719c235d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:22.693509 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-98e8a49c-9a9b-42bb-b64c-4752719c235d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:22.699923 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-98e8a49c-9a9b-42bb-b64c-4752719c235d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:22.700409 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-98e8a49c-9a9b-42bb-b64c-4752719c235d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:22.701620 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-98e8a49c-9a9b-42bb-b64c-4752719c235d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:22.702338 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-98e8a49c-9a9b-42bb-b64c-4752719c235d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:22.702799 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-98e8a49c-9a9b-42bb-b64c-4752719c235d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:22.703225 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-98e8a49c-9a9b-42bb-b64c-4752719c235d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:22.829893 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-98e8a49c-9a9b-42bb-b64c-4752719c235d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:22.838177 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-98e8a49c-9a9b-42bb-b64c-4752719c235d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:22.839629 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-98e8a49c-9a9b-42bb-b64c-4752719c235d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:22.840815 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-98e8a49c-9a9b-42bb-b64c-4752719c235d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1745 microversion: 2.20 time: 0.151846 Sep 25 04:40:22.841438 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 296/537] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:22 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:23.867086 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-82931277-ab97-4300-bdb4-fee1dbb09ee8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:23.868327 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-82931277-ab97-4300-bdb4-fee1dbb09ee8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:23.875765 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-82931277-ab97-4300-bdb4-fee1dbb09ee8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:23.876482 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-82931277-ab97-4300-bdb4-fee1dbb09ee8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:23.877594 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-82931277-ab97-4300-bdb4-fee1dbb09ee8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:23.878488 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-82931277-ab97-4300-bdb4-fee1dbb09ee8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:23.879135 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-82931277-ab97-4300-bdb4-fee1dbb09ee8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:23.879564 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-82931277-ab97-4300-bdb4-fee1dbb09ee8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:24.021906 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-82931277-ab97-4300-bdb4-fee1dbb09ee8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:24.031354 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-82931277-ab97-4300-bdb4-fee1dbb09ee8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:24.032821 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-82931277-ab97-4300-bdb4-fee1dbb09ee8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:24.034320 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-82931277-ab97-4300-bdb4-fee1dbb09ee8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1740 microversion: 2.20 time: 0.171722 Sep 25 04:40:24.034939 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 242/538] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:23 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:25.059978 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-8497d0cb-1a1a-40a8-b828-19f3779de6a2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:25.061114 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-8497d0cb-1a1a-40a8-b828-19f3779de6a2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:25.070203 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8497d0cb-1a1a-40a8-b828-19f3779de6a2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:25.070844 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8497d0cb-1a1a-40a8-b828-19f3779de6a2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:25.071278 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8497d0cb-1a1a-40a8-b828-19f3779de6a2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:25.072116 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8497d0cb-1a1a-40a8-b828-19f3779de6a2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:25.072565 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8497d0cb-1a1a-40a8-b828-19f3779de6a2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:25.073040 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8497d0cb-1a1a-40a8-b828-19f3779de6a2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:25.227112 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-8497d0cb-1a1a-40a8-b828-19f3779de6a2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:25.236211 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-8497d0cb-1a1a-40a8-b828-19f3779de6a2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:25.237881 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-8497d0cb-1a1a-40a8-b828-19f3779de6a2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:25.239040 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-8497d0cb-1a1a-40a8-b828-19f3779de6a2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1740 microversion: 2.20 time: 0.182988 Sep 25 04:40:25.241437 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 297/539] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:25 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:26.264631 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-0b6e2f39-381c-4202-b677-6d3a42a2de2b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:26.266182 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-0b6e2f39-381c-4202-b677-6d3a42a2de2b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:26.277747 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0b6e2f39-381c-4202-b677-6d3a42a2de2b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:26.278757 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0b6e2f39-381c-4202-b677-6d3a42a2de2b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:26.279217 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0b6e2f39-381c-4202-b677-6d3a42a2de2b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:26.279960 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0b6e2f39-381c-4202-b677-6d3a42a2de2b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:26.280428 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0b6e2f39-381c-4202-b677-6d3a42a2de2b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:26.280937 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0b6e2f39-381c-4202-b677-6d3a42a2de2b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:26.427975 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-0b6e2f39-381c-4202-b677-6d3a42a2de2b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:26.437725 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-0b6e2f39-381c-4202-b677-6d3a42a2de2b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:26.439181 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-0b6e2f39-381c-4202-b677-6d3a42a2de2b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:26.440370 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-0b6e2f39-381c-4202-b677-6d3a42a2de2b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1740 microversion: 2.20 time: 0.180795 Sep 25 04:40:26.441224 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 243/540] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:26 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:27.466120 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-0639aa6c-8316-4466-a081-cb5fad7418cc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:27.468178 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-0639aa6c-8316-4466-a081-cb5fad7418cc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:27.474771 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0639aa6c-8316-4466-a081-cb5fad7418cc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:27.475587 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0639aa6c-8316-4466-a081-cb5fad7418cc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:27.476252 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0639aa6c-8316-4466-a081-cb5fad7418cc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:27.477370 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0639aa6c-8316-4466-a081-cb5fad7418cc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:27.478126 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0639aa6c-8316-4466-a081-cb5fad7418cc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:27.478765 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0639aa6c-8316-4466-a081-cb5fad7418cc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:27.626304 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-0639aa6c-8316-4466-a081-cb5fad7418cc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:27.636309 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-0639aa6c-8316-4466-a081-cb5fad7418cc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:27.637808 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-0639aa6c-8316-4466-a081-cb5fad7418cc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:27.639190 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-0639aa6c-8316-4466-a081-cb5fad7418cc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1740 microversion: 2.20 time: 0.177037 Sep 25 04:40:27.639935 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 298/541] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:27 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:28.664878 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-8748a8f9-6866-44c6-b8d5-30a9b6a86cea tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:28.665510 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-8748a8f9-6866-44c6-b8d5-30a9b6a86cea tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:28.672009 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8748a8f9-6866-44c6-b8d5-30a9b6a86cea tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:28.672492 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8748a8f9-6866-44c6-b8d5-30a9b6a86cea tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:28.672949 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8748a8f9-6866-44c6-b8d5-30a9b6a86cea tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:28.673646 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8748a8f9-6866-44c6-b8d5-30a9b6a86cea tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:28.674106 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8748a8f9-6866-44c6-b8d5-30a9b6a86cea tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:28.674531 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8748a8f9-6866-44c6-b8d5-30a9b6a86cea tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:28.840368 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-8748a8f9-6866-44c6-b8d5-30a9b6a86cea tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:28.851298 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-8748a8f9-6866-44c6-b8d5-30a9b6a86cea tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:28.853020 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-8748a8f9-6866-44c6-b8d5-30a9b6a86cea tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:28.854463 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-8748a8f9-6866-44c6-b8d5-30a9b6a86cea tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1740 microversion: 2.20 time: 0.193548 Sep 25 04:40:28.855551 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 244/542] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:28 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:29.885341 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-8d8d1741-f2d6-4462-9fd0-1d154082d6d0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:29.886581 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-8d8d1741-f2d6-4462-9fd0-1d154082d6d0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:29.893867 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8d8d1741-f2d6-4462-9fd0-1d154082d6d0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:29.894350 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8d8d1741-f2d6-4462-9fd0-1d154082d6d0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:29.894786 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8d8d1741-f2d6-4462-9fd0-1d154082d6d0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:29.895476 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8d8d1741-f2d6-4462-9fd0-1d154082d6d0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:29.895926 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8d8d1741-f2d6-4462-9fd0-1d154082d6d0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:29.896346 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8d8d1741-f2d6-4462-9fd0-1d154082d6d0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:29.914903 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=100 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:30.039201 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-8d8d1741-f2d6-4462-9fd0-1d154082d6d0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:30.047918 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-8d8d1741-f2d6-4462-9fd0-1d154082d6d0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:30.049376 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-8d8d1741-f2d6-4462-9fd0-1d154082d6d0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:30.050520 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-8d8d1741-f2d6-4462-9fd0-1d154082d6d0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1740 microversion: 2.20 time: 0.169631 Sep 25 04:40:30.051276 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 299/543] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:29 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:31.076965 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-08d596b4-160a-40bb-b17a-347a10e2d361 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:31.078993 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-08d596b4-160a-40bb-b17a-347a10e2d361 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:31.085987 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-08d596b4-160a-40bb-b17a-347a10e2d361 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:31.086759 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-08d596b4-160a-40bb-b17a-347a10e2d361 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:31.087433 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-08d596b4-160a-40bb-b17a-347a10e2d361 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:31.088489 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-08d596b4-160a-40bb-b17a-347a10e2d361 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:31.089040 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-08d596b4-160a-40bb-b17a-347a10e2d361 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:31.089553 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-08d596b4-160a-40bb-b17a-347a10e2d361 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:31.238361 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-08d596b4-160a-40bb-b17a-347a10e2d361 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:31.248011 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-08d596b4-160a-40bb-b17a-347a10e2d361 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:31.249867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-08d596b4-160a-40bb-b17a-347a10e2d361 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:31.251146 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-08d596b4-160a-40bb-b17a-347a10e2d361 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1740 microversion: 2.20 time: 0.178386 Sep 25 04:40:31.263571 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 245/544] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:31 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:32.282317 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-bc16b3ae-5fd4-4fc9-91bd-78c7f41cdedd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:32.284060 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-bc16b3ae-5fd4-4fc9-91bd-78c7f41cdedd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:32.288501 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:32.292451 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bc16b3ae-5fd4-4fc9-91bd-78c7f41cdedd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:32.292967 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bc16b3ae-5fd4-4fc9-91bd-78c7f41cdedd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:32.293404 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bc16b3ae-5fd4-4fc9-91bd-78c7f41cdedd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:32.294749 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bc16b3ae-5fd4-4fc9-91bd-78c7f41cdedd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:32.295540 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bc16b3ae-5fd4-4fc9-91bd-78c7f41cdedd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:32.296008 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bc16b3ae-5fd4-4fc9-91bd-78c7f41cdedd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:32.455869 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-bc16b3ae-5fd4-4fc9-91bd-78c7f41cdedd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:32.464778 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-bc16b3ae-5fd4-4fc9-91bd-78c7f41cdedd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:32.467945 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-bc16b3ae-5fd4-4fc9-91bd-78c7f41cdedd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:32.468473 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-bc16b3ae-5fd4-4fc9-91bd-78c7f41cdedd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1740 microversion: 2.20 time: 0.193465 Sep 25 04:40:32.469500 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 300/545] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:32 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:33.494701 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-63c499d4-d3e5-492b-91d2-8f117d658832 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:33.495928 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-63c499d4-d3e5-492b-91d2-8f117d658832 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:33.499222 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_api:SELECT=46 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:33.505261 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-63c499d4-d3e5-492b-91d2-8f117d658832 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:33.505830 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-63c499d4-d3e5-492b-91d2-8f117d658832 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:33.506360 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-63c499d4-d3e5-492b-91d2-8f117d658832 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:33.507137 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-63c499d4-d3e5-492b-91d2-8f117d658832 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:33.507653 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-63c499d4-d3e5-492b-91d2-8f117d658832 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:33.508142 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-63c499d4-d3e5-492b-91d2-8f117d658832 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:33.661271 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-63c499d4-d3e5-492b-91d2-8f117d658832 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:33.670145 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-63c499d4-d3e5-492b-91d2-8f117d658832 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:33.671674 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-63c499d4-d3e5-492b-91d2-8f117d658832 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:33.672930 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-63c499d4-d3e5-492b-91d2-8f117d658832 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1740 microversion: 2.20 time: 0.182049 Sep 25 04:40:33.688675 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 246/546] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:33 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:34.699739 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-1efe7146-fa85-4994-9345-c6b3ae893391 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:34.700400 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-1efe7146-fa85-4994-9345-c6b3ae893391 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:34.707088 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1efe7146-fa85-4994-9345-c6b3ae893391 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:34.707562 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1efe7146-fa85-4994-9345-c6b3ae893391 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:34.707991 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1efe7146-fa85-4994-9345-c6b3ae893391 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:34.708689 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1efe7146-fa85-4994-9345-c6b3ae893391 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:34.709139 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1efe7146-fa85-4994-9345-c6b3ae893391 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:34.709562 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1efe7146-fa85-4994-9345-c6b3ae893391 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:34.840229 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-1efe7146-fa85-4994-9345-c6b3ae893391 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:34.849125 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-1efe7146-fa85-4994-9345-c6b3ae893391 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:34.850568 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-1efe7146-fa85-4994-9345-c6b3ae893391 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:34.851706 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-1efe7146-fa85-4994-9345-c6b3ae893391 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1740 microversion: 2.20 time: 0.155994 Sep 25 04:40:34.852290 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 301/547] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:34 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1740 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 04:40:35.877486 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-01fcdc59-8650-492d-9737-6d86625b5d3a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:35.878029 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-01fcdc59-8650-492d-9737-6d86625b5d3a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:35.884389 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-01fcdc59-8650-492d-9737-6d86625b5d3a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:35.884903 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-01fcdc59-8650-492d-9737-6d86625b5d3a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:35.885343 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-01fcdc59-8650-492d-9737-6d86625b5d3a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:35.886027 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-01fcdc59-8650-492d-9737-6d86625b5d3a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:35.886479 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-01fcdc59-8650-492d-9737-6d86625b5d3a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:35.886902 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-01fcdc59-8650-492d-9737-6d86625b5d3a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:36.015477 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-01fcdc59-8650-492d-9737-6d86625b5d3a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:36.023514 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-01fcdc59-8650-492d-9737-6d86625b5d3a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:36.024985 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-01fcdc59-8650-492d-9737-6d86625b5d3a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:36.026137 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-01fcdc59-8650-492d-9737-6d86625b5d3a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1722 microversion: 2.20 time: 0.152843 Sep 25 04:40:36.026687 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 247/548] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:35 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:37.051247 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-c209ca0b-2885-429d-bf3e-0452e67a373d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:37.051850 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-c209ca0b-2885-429d-bf3e-0452e67a373d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:37.058877 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c209ca0b-2885-429d-bf3e-0452e67a373d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:37.059303 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c209ca0b-2885-429d-bf3e-0452e67a373d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:37.059739 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c209ca0b-2885-429d-bf3e-0452e67a373d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:37.060480 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c209ca0b-2885-429d-bf3e-0452e67a373d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:37.060947 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c209ca0b-2885-429d-bf3e-0452e67a373d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:37.061369 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c209ca0b-2885-429d-bf3e-0452e67a373d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:37.193983 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-0adf368e-10a2-4ec4-9de9-43c5ebc9993b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8782e967-ac59-4743-9b18-ab2a004d6ab8"}} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:40:37.195437 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-c209ca0b-2885-429d-bf3e-0452e67a373d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:37.196280 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-0adf368e-10a2-4ec4-9de9-43c5ebc9993b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:37.204354 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0adf368e-10a2-4ec4-9de9-43c5ebc9993b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:37.204868 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0adf368e-10a2-4ec4-9de9-43c5ebc9993b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:37.205124 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-c209ca0b-2885-429d-bf3e-0452e67a373d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:37.205303 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0adf368e-10a2-4ec4-9de9-43c5ebc9993b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:37.205997 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0adf368e-10a2-4ec4-9de9-43c5ebc9993b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:37.206450 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0adf368e-10a2-4ec4-9de9-43c5ebc9993b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:37.206566 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-c209ca0b-2885-429d-bf3e-0452e67a373d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:37.206872 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0adf368e-10a2-4ec4-9de9-43c5ebc9993b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:37.207697 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-c209ca0b-2885-429d-bf3e-0452e67a373d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1722 microversion: 2.20 time: 0.160401 Sep 25 04:40:37.208249 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 302/549] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:37 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:37.361280 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=100 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:37.473276 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-0adf368e-10a2-4ec4-9de9-43c5ebc9993b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "POST /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283021 Sep 25 04:40:37.473873 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 248/550] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Sep 25 04:40:37 2022] POST /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 04:40:38.234302 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-4729907a-b478-4084-9103-4aa2c7d731f0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:38.234908 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-4729907a-b478-4084-9103-4aa2c7d731f0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:38.241368 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4729907a-b478-4084-9103-4aa2c7d731f0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:38.241844 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4729907a-b478-4084-9103-4aa2c7d731f0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:38.242278 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4729907a-b478-4084-9103-4aa2c7d731f0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:38.242951 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4729907a-b478-4084-9103-4aa2c7d731f0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:38.243398 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4729907a-b478-4084-9103-4aa2c7d731f0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:38.243816 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4729907a-b478-4084-9103-4aa2c7d731f0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:38.379821 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-4729907a-b478-4084-9103-4aa2c7d731f0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:38.388233 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-4729907a-b478-4084-9103-4aa2c7d731f0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:38.390193 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-4729907a-b478-4084-9103-4aa2c7d731f0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:38.391520 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-4729907a-b478-4084-9103-4aa2c7d731f0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1725 microversion: 2.20 time: 0.161582 Sep 25 04:40:38.392189 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 303/551] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:38 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:38.418044 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-83ce6831-f970-49f2-b29f-bcbbce8f20e7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d23d85f2-86e3-4a50-8cf7-fda618bf290b"}} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:40:38.421217 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-83ce6831-f970-49f2-b29f-bcbbce8f20e7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:38.427404 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-83ce6831-f970-49f2-b29f-bcbbce8f20e7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:38.427893 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-83ce6831-f970-49f2-b29f-bcbbce8f20e7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:38.428334 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-83ce6831-f970-49f2-b29f-bcbbce8f20e7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:38.429060 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-83ce6831-f970-49f2-b29f-bcbbce8f20e7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:38.429520 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-83ce6831-f970-49f2-b29f-bcbbce8f20e7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:38.429948 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-83ce6831-f970-49f2-b29f-bcbbce8f20e7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:38.719065 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-83ce6831-f970-49f2-b29f-bcbbce8f20e7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "POST /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.305919 Sep 25 04:40:38.719768 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 249/552] 10.222.0.25 () {62 vars in 1364 bytes} [Sun Sep 25 04:40:38 2022] POST /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14/os-volume_attachments => generated 188 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 04:40:38.842699 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-860fef6f-5812-41e2-82c2-175f45b07d27 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:40:38.843283 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-860fef6f-5812-41e2-82c2-175f45b07d27 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:38.849234 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-860fef6f-5812-41e2-82c2-175f45b07d27 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:38.849711 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-860fef6f-5812-41e2-82c2-175f45b07d27 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:38.850167 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-860fef6f-5812-41e2-82c2-175f45b07d27 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:38.850841 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-860fef6f-5812-41e2-82c2-175f45b07d27 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:38.851288 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-860fef6f-5812-41e2-82c2-175f45b07d27 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:38.851705 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-860fef6f-5812-41e2-82c2-175f45b07d27 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:38.893737 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-860fef6f-5812-41e2-82c2-175f45b07d27 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127142) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 25 04:40:38.960723 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-860fef6f-5812-41e2-82c2-175f45b07d27 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "POST /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14/action" status: 202 len: 0 microversion: 2.20 time: 0.122192 Sep 25 04:40:38.961325 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 304/553] 10.222.0.25 () {62 vars in 1319 bytes} [Sun Sep 25 04:40:38 2022] POST /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 25 04:40:38.969595 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-4710e8f6-7f5b-47d8-af22-2f6f1f6a734f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:38.970216 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-4710e8f6-7f5b-47d8-af22-2f6f1f6a734f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:38.976828 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4710e8f6-7f5b-47d8-af22-2f6f1f6a734f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:38.977323 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4710e8f6-7f5b-47d8-af22-2f6f1f6a734f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:38.977762 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4710e8f6-7f5b-47d8-af22-2f6f1f6a734f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:38.978461 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4710e8f6-7f5b-47d8-af22-2f6f1f6a734f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:38.978920 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4710e8f6-7f5b-47d8-af22-2f6f1f6a734f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:38.979355 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4710e8f6-7f5b-47d8-af22-2f6f1f6a734f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:39.115037 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-4710e8f6-7f5b-47d8-af22-2f6f1f6a734f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:39.125047 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-4710e8f6-7f5b-47d8-af22-2f6f1f6a734f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:39.126528 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-4710e8f6-7f5b-47d8-af22-2f6f1f6a734f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:39.127709 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-4710e8f6-7f5b-47d8-af22-2f6f1f6a734f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1751 microversion: 2.20 time: 0.162244 Sep 25 04:40:39.128262 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 250/554] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:38 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:39.398164 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-66a7b8b0-68f6-4bd4-9044-164d67eab2ed req-0a600b7e-68d9-4f2c-a979-93e7e1f2053e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9e99419-ae76-4d84-9e7a-d0a31530ea14", "name": "network-vif-unplugged", "status": "completed", "tag": "28807ae7-bb46-4e31-93d7-48170864edca"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:40:39.409176 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-66a7b8b0-68f6-4bd4-9044-164d67eab2ed req-0a600b7e-68d9-4f2c-a979-93e7e1f2053e service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:39.410215 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-66a7b8b0-68f6-4bd4-9044-164d67eab2ed req-0a600b7e-68d9-4f2c-a979-93e7e1f2053e service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:39.410651 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-66a7b8b0-68f6-4bd4-9044-164d67eab2ed req-0a600b7e-68d9-4f2c-a979-93e7e1f2053e service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:39.424799 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.compute.server_external_events [req-66a7b8b0-68f6-4bd4-9044-164d67eab2ed req-0a600b7e-68d9-4f2c-a979-93e7e1f2053e service nova] Unable to find a host for instance c9e99419-ae76-4d84-9e7a-d0a31530ea14. Dropping event network-vif-unplugged {{(pid=127142) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 25 04:40:39.425993 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-66a7b8b0-68f6-4bd4-9044-164d67eab2ed req-0a600b7e-68d9-4f2c-a979-93e7e1f2053e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032094 Sep 25 04:40:39.427036 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 305/555] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 25 04:40:40.153709 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-43fc8942-e51e-4474-b27c-2f9567cb7db8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:40.155093 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-43fc8942-e51e-4474-b27c-2f9567cb7db8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:40.161543 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-43fc8942-e51e-4474-b27c-2f9567cb7db8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:40.162036 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-43fc8942-e51e-4474-b27c-2f9567cb7db8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:40.162481 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-43fc8942-e51e-4474-b27c-2f9567cb7db8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:40.163175 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-43fc8942-e51e-4474-b27c-2f9567cb7db8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:40.163636 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-43fc8942-e51e-4474-b27c-2f9567cb7db8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:40.164067 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-43fc8942-e51e-4474-b27c-2f9567cb7db8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:40.290614 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-43fc8942-e51e-4474-b27c-2f9567cb7db8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:40.299212 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-43fc8942-e51e-4474-b27c-2f9567cb7db8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:40.300672 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-43fc8942-e51e-4474-b27c-2f9567cb7db8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:40.301830 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-43fc8942-e51e-4474-b27c-2f9567cb7db8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1753 microversion: 2.20 time: 0.152076 Sep 25 04:40:40.302384 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 251/556] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:40 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 04:40:41.328993 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-5adf7b44-f9ae-4425-b284-22090607a8a1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:41.330085 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-5adf7b44-f9ae-4425-b284-22090607a8a1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:41.337430 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5adf7b44-f9ae-4425-b284-22090607a8a1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:41.337945 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5adf7b44-f9ae-4425-b284-22090607a8a1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:41.338458 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5adf7b44-f9ae-4425-b284-22090607a8a1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:41.339219 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5adf7b44-f9ae-4425-b284-22090607a8a1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:41.339669 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5adf7b44-f9ae-4425-b284-22090607a8a1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:41.340084 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5adf7b44-f9ae-4425-b284-22090607a8a1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:41.472191 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-5adf7b44-f9ae-4425-b284-22090607a8a1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:41.481617 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-5adf7b44-f9ae-4425-b284-22090607a8a1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:41.483915 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-5adf7b44-f9ae-4425-b284-22090607a8a1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:41.485270 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-5adf7b44-f9ae-4425-b284-22090607a8a1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1753 microversion: 2.20 time: 0.161474 Sep 25 04:40:41.486071 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 306/557] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:41 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:42.511351 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-0d39cd61-4ac0-4f3d-b007-954af69e5ca7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:42.511956 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-0d39cd61-4ac0-4f3d-b007-954af69e5ca7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:42.519168 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0d39cd61-4ac0-4f3d-b007-954af69e5ca7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:42.519651 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0d39cd61-4ac0-4f3d-b007-954af69e5ca7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:42.520080 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0d39cd61-4ac0-4f3d-b007-954af69e5ca7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:42.520799 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0d39cd61-4ac0-4f3d-b007-954af69e5ca7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:42.521251 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0d39cd61-4ac0-4f3d-b007-954af69e5ca7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:42.521672 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0d39cd61-4ac0-4f3d-b007-954af69e5ca7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:42.649215 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-0d39cd61-4ac0-4f3d-b007-954af69e5ca7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:42.657831 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-0d39cd61-4ac0-4f3d-b007-954af69e5ca7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:42.659295 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-0d39cd61-4ac0-4f3d-b007-954af69e5ca7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:42.660451 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-0d39cd61-4ac0-4f3d-b007-954af69e5ca7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1753 microversion: 2.20 time: 0.153018 Sep 25 04:40:42.661048 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 252/558] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:42 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:43.685433 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-8ac3686e-d527-4fa9-8fe4-4c9576ccd86f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:43.686032 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-8ac3686e-d527-4fa9-8fe4-4c9576ccd86f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:43.692940 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8ac3686e-d527-4fa9-8fe4-4c9576ccd86f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:43.693425 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8ac3686e-d527-4fa9-8fe4-4c9576ccd86f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:43.693861 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8ac3686e-d527-4fa9-8fe4-4c9576ccd86f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:43.694574 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8ac3686e-d527-4fa9-8fe4-4c9576ccd86f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:43.695027 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8ac3686e-d527-4fa9-8fe4-4c9576ccd86f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:43.695447 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8ac3686e-d527-4fa9-8fe4-4c9576ccd86f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:43.825027 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-8ac3686e-d527-4fa9-8fe4-4c9576ccd86f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:43.834143 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-8ac3686e-d527-4fa9-8fe4-4c9576ccd86f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:43.835889 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-8ac3686e-d527-4fa9-8fe4-4c9576ccd86f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:43.837217 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-8ac3686e-d527-4fa9-8fe4-4c9576ccd86f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1753 microversion: 2.20 time: 0.155626 Sep 25 04:40:43.837776 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 307/559] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:43 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:44.865344 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-6e880c1c-af6f-42ac-8c5b-f324e032701a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:44.865940 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-6e880c1c-af6f-42ac-8c5b-f324e032701a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:44.872330 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6e880c1c-af6f-42ac-8c5b-f324e032701a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:44.872877 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6e880c1c-af6f-42ac-8c5b-f324e032701a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:44.873299 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6e880c1c-af6f-42ac-8c5b-f324e032701a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:44.874764 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6e880c1c-af6f-42ac-8c5b-f324e032701a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:44.875238 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6e880c1c-af6f-42ac-8c5b-f324e032701a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:44.875665 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6e880c1c-af6f-42ac-8c5b-f324e032701a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:45.013740 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-6e880c1c-af6f-42ac-8c5b-f324e032701a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:45.026608 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-6e880c1c-af6f-42ac-8c5b-f324e032701a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:45.028044 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-6e880c1c-af6f-42ac-8c5b-f324e032701a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:45.029242 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-6e880c1c-af6f-42ac-8c5b-f324e032701a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1753 microversion: 2.20 time: 0.169319 Sep 25 04:40:45.029792 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 253/560] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:44 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:45.054610 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-7a58969c-2f8e-4d4c-a372-6705058c7981 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:40:45.056975 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-7a58969c-2f8e-4d4c-a372-6705058c7981 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:45.064752 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7a58969c-2f8e-4d4c-a372-6705058c7981 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:45.065257 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7a58969c-2f8e-4d4c-a372-6705058c7981 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:45.065694 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7a58969c-2f8e-4d4c-a372-6705058c7981 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:45.066393 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7a58969c-2f8e-4d4c-a372-6705058c7981 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:45.067079 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7a58969c-2f8e-4d4c-a372-6705058c7981 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:45.067631 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7a58969c-2f8e-4d4c-a372-6705058c7981 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:45.096366 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.objects.instance [None req-7a58969c-2f8e-4d4c-a372-6705058c7981 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lazy-loading 'flavor' on Instance uuid 1348d173-f0db-4d60-94f5-1765387d7294 {{(pid=127142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 04:40:45.231559 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-7a58969c-2f8e-4d4c-a372-6705058c7981 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "POST /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294/action" status: 200 len: 32 microversion: 2.1 time: 0.181720 Sep 25 04:40:45.232133 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 308/561] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 25 04:40:45 2022] POST /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294/action => generated 32 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 04:40:45.243437 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-1293b6e6-c089-47df-9793-f7a7985e1c5a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:45.244183 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-1293b6e6-c089-47df-9793-f7a7985e1c5a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:45.251119 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1293b6e6-c089-47df-9793-f7a7985e1c5a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:45.251612 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1293b6e6-c089-47df-9793-f7a7985e1c5a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:45.252054 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1293b6e6-c089-47df-9793-f7a7985e1c5a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:45.252793 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1293b6e6-c089-47df-9793-f7a7985e1c5a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:45.253243 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1293b6e6-c089-47df-9793-f7a7985e1c5a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:45.253843 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1293b6e6-c089-47df-9793-f7a7985e1c5a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:45.481147 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-1293b6e6-c089-47df-9793-f7a7985e1c5a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:45.491070 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-1293b6e6-c089-47df-9793-f7a7985e1c5a tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1734 microversion: 2.1 time: 0.251414 Sep 25 04:40:45.491899 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 254/562] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:40:45 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1734 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:40:46.056081 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-633f5f0c-0fb1-40f2-9c61-3db4abdf8c9d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:46.056845 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-633f5f0c-0fb1-40f2-9c61-3db4abdf8c9d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:46.063269 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-633f5f0c-0fb1-40f2-9c61-3db4abdf8c9d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:46.063758 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-633f5f0c-0fb1-40f2-9c61-3db4abdf8c9d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:46.064202 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-633f5f0c-0fb1-40f2-9c61-3db4abdf8c9d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:46.064992 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-633f5f0c-0fb1-40f2-9c61-3db4abdf8c9d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:46.065455 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-633f5f0c-0fb1-40f2-9c61-3db4abdf8c9d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:46.065886 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-633f5f0c-0fb1-40f2-9c61-3db4abdf8c9d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:46.196593 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-633f5f0c-0fb1-40f2-9c61-3db4abdf8c9d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:46.206839 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-633f5f0c-0fb1-40f2-9c61-3db4abdf8c9d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:46.208302 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-633f5f0c-0fb1-40f2-9c61-3db4abdf8c9d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:46.209504 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-633f5f0c-0fb1-40f2-9c61-3db4abdf8c9d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1809 microversion: 2.20 time: 0.157851 Sep 25 04:40:46.210065 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 309/563] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:46 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:46.517668 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-166c4658-ae50-49ee-b592-3929d54bcad5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:46.518274 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-166c4658-ae50-49ee-b592-3929d54bcad5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:46.524705 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-166c4658-ae50-49ee-b592-3929d54bcad5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:46.525188 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-166c4658-ae50-49ee-b592-3929d54bcad5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:46.525623 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-166c4658-ae50-49ee-b592-3929d54bcad5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:46.526300 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-166c4658-ae50-49ee-b592-3929d54bcad5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:46.526754 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-166c4658-ae50-49ee-b592-3929d54bcad5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:46.527173 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-166c4658-ae50-49ee-b592-3929d54bcad5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:46.654927 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-166c4658-ae50-49ee-b592-3929d54bcad5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:46.664853 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-166c4658-ae50-49ee-b592-3929d54bcad5 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1734 microversion: 2.1 time: 0.151994 Sep 25 04:40:46.665415 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 255/564] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:40:46 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:40:47.235537 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-4bc85a06-169a-491c-8698-56f19939e99b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:47.236148 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-4bc85a06-169a-491c-8698-56f19939e99b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:47.242775 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4bc85a06-169a-491c-8698-56f19939e99b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:47.243261 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4bc85a06-169a-491c-8698-56f19939e99b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:47.243697 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4bc85a06-169a-491c-8698-56f19939e99b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:47.244383 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4bc85a06-169a-491c-8698-56f19939e99b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:47.244937 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4bc85a06-169a-491c-8698-56f19939e99b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:47.245362 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4bc85a06-169a-491c-8698-56f19939e99b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:47.461346 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-4bc85a06-169a-491c-8698-56f19939e99b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:47.470570 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-4bc85a06-169a-491c-8698-56f19939e99b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:47.472009 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-4bc85a06-169a-491c-8698-56f19939e99b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:47.473219 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-4bc85a06-169a-491c-8698-56f19939e99b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1809 microversion: 2.20 time: 0.242294 Sep 25 04:40:47.473774 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 310/565] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:47 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1809 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:47.687279 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-8d21e998-43a4-43f5-b2a3-16e8ba1be923 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:47.687911 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-8d21e998-43a4-43f5-b2a3-16e8ba1be923 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:47.694497 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8d21e998-43a4-43f5-b2a3-16e8ba1be923 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:47.694976 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8d21e998-43a4-43f5-b2a3-16e8ba1be923 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:47.695412 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8d21e998-43a4-43f5-b2a3-16e8ba1be923 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:47.696100 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8d21e998-43a4-43f5-b2a3-16e8ba1be923 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:47.696555 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8d21e998-43a4-43f5-b2a3-16e8ba1be923 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:47.697005 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8d21e998-43a4-43f5-b2a3-16e8ba1be923 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:47.837092 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-8d21e998-43a4-43f5-b2a3-16e8ba1be923 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:47.847022 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-8d21e998-43a4-43f5-b2a3-16e8ba1be923 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1734 microversion: 2.1 time: 0.163176 Sep 25 04:40:47.848105 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 256/566] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:40:47 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:40:48.498708 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-6ee5939f-ad9b-44ae-9206-b59dabd162ac tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:48.499450 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-6ee5939f-ad9b-44ae-9206-b59dabd162ac tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:48.506382 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6ee5939f-ad9b-44ae-9206-b59dabd162ac tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:48.506957 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6ee5939f-ad9b-44ae-9206-b59dabd162ac tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:48.507467 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6ee5939f-ad9b-44ae-9206-b59dabd162ac tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:48.508244 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6ee5939f-ad9b-44ae-9206-b59dabd162ac tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:48.508831 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6ee5939f-ad9b-44ae-9206-b59dabd162ac tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:48.509338 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6ee5939f-ad9b-44ae-9206-b59dabd162ac tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:48.648706 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-6ee5939f-ad9b-44ae-9206-b59dabd162ac tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:48.658283 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-6ee5939f-ad9b-44ae-9206-b59dabd162ac tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:48.659778 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-6ee5939f-ad9b-44ae-9206-b59dabd162ac tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:48.660985 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-6ee5939f-ad9b-44ae-9206-b59dabd162ac tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1809 microversion: 2.20 time: 0.166218 Sep 25 04:40:48.661552 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 311/567] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:48 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:48.870234 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-6cb426a8-10a5-4114-b6b3-926ba691fd76 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:48.870801 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-6cb426a8-10a5-4114-b6b3-926ba691fd76 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:48.877391 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6cb426a8-10a5-4114-b6b3-926ba691fd76 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:48.877876 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6cb426a8-10a5-4114-b6b3-926ba691fd76 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:48.878306 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6cb426a8-10a5-4114-b6b3-926ba691fd76 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:48.879174 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6cb426a8-10a5-4114-b6b3-926ba691fd76 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:48.879640 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6cb426a8-10a5-4114-b6b3-926ba691fd76 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:48.880298 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6cb426a8-10a5-4114-b6b3-926ba691fd76 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:49.020992 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-6cb426a8-10a5-4114-b6b3-926ba691fd76 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:49.029433 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-6cb426a8-10a5-4114-b6b3-926ba691fd76 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1734 microversion: 2.1 time: 0.163121 Sep 25 04:40:49.030030 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 257/568] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:40:48 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:40:49.689848 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-12fee409-1791-4fcf-8c54-3b9340939764 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:49.690417 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-12fee409-1791-4fcf-8c54-3b9340939764 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:49.696956 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-12fee409-1791-4fcf-8c54-3b9340939764 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:49.697447 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-12fee409-1791-4fcf-8c54-3b9340939764 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:49.697884 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-12fee409-1791-4fcf-8c54-3b9340939764 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:49.698582 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-12fee409-1791-4fcf-8c54-3b9340939764 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:49.699062 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-12fee409-1791-4fcf-8c54-3b9340939764 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:49.699484 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-12fee409-1791-4fcf-8c54-3b9340939764 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:49.840479 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-12fee409-1791-4fcf-8c54-3b9340939764 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:49.850097 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-12fee409-1791-4fcf-8c54-3b9340939764 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:49.851517 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-12fee409-1791-4fcf-8c54-3b9340939764 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:49.852823 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-12fee409-1791-4fcf-8c54-3b9340939764 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1809 microversion: 2.20 time: 0.167429 Sep 25 04:40:49.853455 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 312/569] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:49 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:50.055476 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-fb1b9872-c45f-46e2-a7e1-809b317f19ba tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:50.056128 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-fb1b9872-c45f-46e2-a7e1-809b317f19ba tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:50.063802 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fb1b9872-c45f-46e2-a7e1-809b317f19ba tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:50.064292 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fb1b9872-c45f-46e2-a7e1-809b317f19ba tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:50.064758 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fb1b9872-c45f-46e2-a7e1-809b317f19ba tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:50.065463 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fb1b9872-c45f-46e2-a7e1-809b317f19ba tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:50.065921 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fb1b9872-c45f-46e2-a7e1-809b317f19ba tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:50.066341 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fb1b9872-c45f-46e2-a7e1-809b317f19ba tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:50.206229 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-fb1b9872-c45f-46e2-a7e1-809b317f19ba tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:50.215552 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-fb1b9872-c45f-46e2-a7e1-809b317f19ba tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1734 microversion: 2.1 time: 0.165359 Sep 25 04:40:50.216124 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 258/570] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:40:50 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:40:50.884769 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-faf97ac7-7e10-4a77-ae6b-bf0ce13cdd72 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:50.886060 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-faf97ac7-7e10-4a77-ae6b-bf0ce13cdd72 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:50.894061 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-faf97ac7-7e10-4a77-ae6b-bf0ce13cdd72 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:50.895118 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-faf97ac7-7e10-4a77-ae6b-bf0ce13cdd72 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:50.895118 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-faf97ac7-7e10-4a77-ae6b-bf0ce13cdd72 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:50.896067 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-faf97ac7-7e10-4a77-ae6b-bf0ce13cdd72 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:50.896248 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-faf97ac7-7e10-4a77-ae6b-bf0ce13cdd72 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:50.896657 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-faf97ac7-7e10-4a77-ae6b-bf0ce13cdd72 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:51.040246 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-faf97ac7-7e10-4a77-ae6b-bf0ce13cdd72 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:51.042549 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:51.050819 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-faf97ac7-7e10-4a77-ae6b-bf0ce13cdd72 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:51.052284 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-faf97ac7-7e10-4a77-ae6b-bf0ce13cdd72 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:51.053505 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-faf97ac7-7e10-4a77-ae6b-bf0ce13cdd72 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1809 microversion: 2.20 time: 0.178155 Sep 25 04:40:51.054056 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 313/571] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:50 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:51.241067 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-52c190d6-b2fb-4969-b7a1-1343fbbedaa4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:51.241657 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-52c190d6-b2fb-4969-b7a1-1343fbbedaa4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:51.248103 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-52c190d6-b2fb-4969-b7a1-1343fbbedaa4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:51.248593 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-52c190d6-b2fb-4969-b7a1-1343fbbedaa4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:51.249072 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-52c190d6-b2fb-4969-b7a1-1343fbbedaa4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:51.249765 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-52c190d6-b2fb-4969-b7a1-1343fbbedaa4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:51.250229 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-52c190d6-b2fb-4969-b7a1-1343fbbedaa4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:51.250655 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-52c190d6-b2fb-4969-b7a1-1343fbbedaa4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:51.388593 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-52c190d6-b2fb-4969-b7a1-1343fbbedaa4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:51.398504 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-52c190d6-b2fb-4969-b7a1-1343fbbedaa4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1734 microversion: 2.1 time: 0.161283 Sep 25 04:40:51.405953 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 259/572] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:40:51 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:40:52.079531 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-6b8fdfc1-5700-4298-93d6-7658ac23ecb9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:52.080153 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-6b8fdfc1-5700-4298-93d6-7658ac23ecb9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:52.088036 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6b8fdfc1-5700-4298-93d6-7658ac23ecb9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:52.088853 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6b8fdfc1-5700-4298-93d6-7658ac23ecb9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:52.089292 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6b8fdfc1-5700-4298-93d6-7658ac23ecb9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:52.089997 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6b8fdfc1-5700-4298-93d6-7658ac23ecb9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:52.090587 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6b8fdfc1-5700-4298-93d6-7658ac23ecb9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:52.091017 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6b8fdfc1-5700-4298-93d6-7658ac23ecb9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:52.234974 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-6b8fdfc1-5700-4298-93d6-7658ac23ecb9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:52.243803 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-6b8fdfc1-5700-4298-93d6-7658ac23ecb9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:52.245323 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-6b8fdfc1-5700-4298-93d6-7658ac23ecb9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:52.246485 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-6b8fdfc1-5700-4298-93d6-7658ac23ecb9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1809 microversion: 2.20 time: 0.171130 Sep 25 04:40:52.247042 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 314/573] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:52 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:52.423314 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-a6465f2e-7b41-4c6b-beca-058994db2776 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:52.424601 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-a6465f2e-7b41-4c6b-beca-058994db2776 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:52.431326 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a6465f2e-7b41-4c6b-beca-058994db2776 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:52.431815 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a6465f2e-7b41-4c6b-beca-058994db2776 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:52.432254 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a6465f2e-7b41-4c6b-beca-058994db2776 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:52.433045 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a6465f2e-7b41-4c6b-beca-058994db2776 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:52.433505 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a6465f2e-7b41-4c6b-beca-058994db2776 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:52.433932 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a6465f2e-7b41-4c6b-beca-058994db2776 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:52.571453 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-a6465f2e-7b41-4c6b-beca-058994db2776 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:52.580569 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-a6465f2e-7b41-4c6b-beca-058994db2776 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1734 microversion: 2.1 time: 0.161294 Sep 25 04:40:52.584803 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 260/574] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:40:52 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:40:53.271735 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-d0cdf298-d9ab-489b-99bd-d5e4b64547bb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:53.272346 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-d0cdf298-d9ab-489b-99bd-d5e4b64547bb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:53.278806 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d0cdf298-d9ab-489b-99bd-d5e4b64547bb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:53.279291 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d0cdf298-d9ab-489b-99bd-d5e4b64547bb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:53.279723 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d0cdf298-d9ab-489b-99bd-d5e4b64547bb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:53.281007 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d0cdf298-d9ab-489b-99bd-d5e4b64547bb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:53.281746 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d0cdf298-d9ab-489b-99bd-d5e4b64547bb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:53.282175 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d0cdf298-d9ab-489b-99bd-d5e4b64547bb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:53.420593 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-d0cdf298-d9ab-489b-99bd-d5e4b64547bb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:53.429344 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-d0cdf298-d9ab-489b-99bd-d5e4b64547bb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:53.430862 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-d0cdf298-d9ab-489b-99bd-d5e4b64547bb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:53.432128 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-d0cdf298-d9ab-489b-99bd-d5e4b64547bb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1809 microversion: 2.20 time: 0.164363 Sep 25 04:40:53.432715 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 315/575] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:53 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:53.604421 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-d3093246-3cb0-413a-8074-da141b56638e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:53.605018 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-d3093246-3cb0-413a-8074-da141b56638e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:53.612298 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d3093246-3cb0-413a-8074-da141b56638e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:53.612839 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d3093246-3cb0-413a-8074-da141b56638e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:53.613277 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d3093246-3cb0-413a-8074-da141b56638e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:53.613987 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d3093246-3cb0-413a-8074-da141b56638e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:53.614444 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d3093246-3cb0-413a-8074-da141b56638e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:53.614871 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d3093246-3cb0-413a-8074-da141b56638e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:53.753805 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-d3093246-3cb0-413a-8074-da141b56638e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:53.756096 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:UPDATE=6,nova_cell1:SELECT=90,nova_cell1:INSERT=4 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:40:53.763472 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-d3093246-3cb0-413a-8074-da141b56638e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1734 microversion: 2.1 time: 0.162982 Sep 25 04:40:53.764049 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 261/576] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:40:53 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:40:54.457885 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-62a6989c-0251-47ae-8b66-ffe03223f83f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:54.458564 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-62a6989c-0251-47ae-8b66-ffe03223f83f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:54.465978 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-62a6989c-0251-47ae-8b66-ffe03223f83f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:54.466597 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-62a6989c-0251-47ae-8b66-ffe03223f83f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:54.467100 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-62a6989c-0251-47ae-8b66-ffe03223f83f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:54.468449 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-62a6989c-0251-47ae-8b66-ffe03223f83f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:54.469199 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-62a6989c-0251-47ae-8b66-ffe03223f83f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:54.470550 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-62a6989c-0251-47ae-8b66-ffe03223f83f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:54.606517 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-62a6989c-0251-47ae-8b66-ffe03223f83f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:54.616989 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-62a6989c-0251-47ae-8b66-ffe03223f83f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:54.618434 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-62a6989c-0251-47ae-8b66-ffe03223f83f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:54.619641 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-62a6989c-0251-47ae-8b66-ffe03223f83f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1809 microversion: 2.20 time: 0.165900 Sep 25 04:40:54.620390 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 316/577] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:54 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:54.787684 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-7f8ec656-a284-41f0-9a5f-af35c860405d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:54.788350 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-7f8ec656-a284-41f0-9a5f-af35c860405d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:54.795909 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7f8ec656-a284-41f0-9a5f-af35c860405d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:54.797028 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7f8ec656-a284-41f0-9a5f-af35c860405d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:54.797468 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7f8ec656-a284-41f0-9a5f-af35c860405d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:54.798164 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7f8ec656-a284-41f0-9a5f-af35c860405d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:54.798624 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7f8ec656-a284-41f0-9a5f-af35c860405d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:54.799055 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7f8ec656-a284-41f0-9a5f-af35c860405d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:55.050592 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-7f8ec656-a284-41f0-9a5f-af35c860405d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:55.059595 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-7f8ec656-a284-41f0-9a5f-af35c860405d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1734 microversion: 2.1 time: 0.275924 Sep 25 04:40:55.060281 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 262/578] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:40:54 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1734 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:40:55.645282 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-06358b75-5198-48dd-a247-26dca1a3b8c9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:55.645897 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-06358b75-5198-48dd-a247-26dca1a3b8c9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:55.655575 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-06358b75-5198-48dd-a247-26dca1a3b8c9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:55.656080 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-06358b75-5198-48dd-a247-26dca1a3b8c9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:55.656520 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-06358b75-5198-48dd-a247-26dca1a3b8c9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:55.657287 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-06358b75-5198-48dd-a247-26dca1a3b8c9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:55.657725 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-06358b75-5198-48dd-a247-26dca1a3b8c9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:55.663660 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-06358b75-5198-48dd-a247-26dca1a3b8c9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:55.837336 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-06358b75-5198-48dd-a247-26dca1a3b8c9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:55.848770 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-06358b75-5198-48dd-a247-26dca1a3b8c9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:55.850255 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-06358b75-5198-48dd-a247-26dca1a3b8c9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:55.851636 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-06358b75-5198-48dd-a247-26dca1a3b8c9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1809 microversion: 2.20 time: 0.210268 Sep 25 04:40:55.852207 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 317/579] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:55 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1809 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:56.084235 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-aabb1b24-1789-4b94-b175-4e2050557dfa tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:56.084979 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-aabb1b24-1789-4b94-b175-4e2050557dfa tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:56.093588 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-aabb1b24-1789-4b94-b175-4e2050557dfa tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:56.094424 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-aabb1b24-1789-4b94-b175-4e2050557dfa tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:56.095242 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-aabb1b24-1789-4b94-b175-4e2050557dfa tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:56.096069 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-aabb1b24-1789-4b94-b175-4e2050557dfa tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:56.096942 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-aabb1b24-1789-4b94-b175-4e2050557dfa tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:56.097693 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-aabb1b24-1789-4b94-b175-4e2050557dfa tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:56.300618 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-aabb1b24-1789-4b94-b175-4e2050557dfa tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:56.309795 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-aabb1b24-1789-4b94-b175-4e2050557dfa tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1734 microversion: 2.1 time: 0.229842 Sep 25 04:40:56.310374 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 263/580] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:40:56 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1734 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:40:56.883874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-57e97603-2081-49c1-99f5-4bdc61349f3f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:56.884662 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-57e97603-2081-49c1-99f5-4bdc61349f3f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:56.891825 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-57e97603-2081-49c1-99f5-4bdc61349f3f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:56.892311 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-57e97603-2081-49c1-99f5-4bdc61349f3f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:56.892782 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-57e97603-2081-49c1-99f5-4bdc61349f3f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:56.893479 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-57e97603-2081-49c1-99f5-4bdc61349f3f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:56.893932 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-57e97603-2081-49c1-99f5-4bdc61349f3f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:56.894359 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-57e97603-2081-49c1-99f5-4bdc61349f3f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:57.085762 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-57e97603-2081-49c1-99f5-4bdc61349f3f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:57.094746 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-57e97603-2081-49c1-99f5-4bdc61349f3f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:57.096219 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-57e97603-2081-49c1-99f5-4bdc61349f3f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:57.097424 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-57e97603-2081-49c1-99f5-4bdc61349f3f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1809 microversion: 2.20 time: 0.219061 Sep 25 04:40:57.097982 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 318/581] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:56 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1809 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:57.334197 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-10016023-e3b6-46c9-9189-3f71caf85e94 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:57.335441 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-10016023-e3b6-46c9-9189-3f71caf85e94 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:57.342485 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-10016023-e3b6-46c9-9189-3f71caf85e94 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:57.343107 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-10016023-e3b6-46c9-9189-3f71caf85e94 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:57.343409 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-10016023-e3b6-46c9-9189-3f71caf85e94 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:57.344118 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-10016023-e3b6-46c9-9189-3f71caf85e94 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:57.344581 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-10016023-e3b6-46c9-9189-3f71caf85e94 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:57.345041 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-10016023-e3b6-46c9-9189-3f71caf85e94 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:57.488241 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-10016023-e3b6-46c9-9189-3f71caf85e94 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:57.496694 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-10016023-e3b6-46c9-9189-3f71caf85e94 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1734 microversion: 2.1 time: 0.166358 Sep 25 04:40:57.497227 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 264/582] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:40:57 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:40:58.123182 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-68689bec-2b80-40ed-a9e6-ca4535bc7e11 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:58.123974 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-68689bec-2b80-40ed-a9e6-ca4535bc7e11 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:58.131280 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-68689bec-2b80-40ed-a9e6-ca4535bc7e11 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:58.131770 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-68689bec-2b80-40ed-a9e6-ca4535bc7e11 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:58.132234 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-68689bec-2b80-40ed-a9e6-ca4535bc7e11 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:58.132966 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-68689bec-2b80-40ed-a9e6-ca4535bc7e11 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:58.133424 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-68689bec-2b80-40ed-a9e6-ca4535bc7e11 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:58.133851 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-68689bec-2b80-40ed-a9e6-ca4535bc7e11 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:58.269288 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-68689bec-2b80-40ed-a9e6-ca4535bc7e11 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:58.278092 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-68689bec-2b80-40ed-a9e6-ca4535bc7e11 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:58.279756 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-68689bec-2b80-40ed-a9e6-ca4535bc7e11 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:58.281997 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-68689bec-2b80-40ed-a9e6-ca4535bc7e11 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1809 microversion: 2.20 time: 0.162652 Sep 25 04:40:58.282782 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 319/583] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:58 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:58.520971 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-817e9f37-6541-4c83-a1ee-fec7b4378877 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:58.521589 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-817e9f37-6541-4c83-a1ee-fec7b4378877 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:58.528207 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-817e9f37-6541-4c83-a1ee-fec7b4378877 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:58.528727 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-817e9f37-6541-4c83-a1ee-fec7b4378877 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:58.529175 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-817e9f37-6541-4c83-a1ee-fec7b4378877 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:58.529865 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-817e9f37-6541-4c83-a1ee-fec7b4378877 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:58.530469 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-817e9f37-6541-4c83-a1ee-fec7b4378877 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:58.530908 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-817e9f37-6541-4c83-a1ee-fec7b4378877 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:58.660110 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-817e9f37-6541-4c83-a1ee-fec7b4378877 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:58.668585 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-817e9f37-6541-4c83-a1ee-fec7b4378877 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1734 microversion: 2.1 time: 0.151490 Sep 25 04:40:58.669207 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 265/584] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:40:58 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:40:59.308790 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-0d489d60-c244-4596-937f-bc0ccbd5f09b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:59.309387 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-0d489d60-c244-4596-937f-bc0ccbd5f09b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:59.316172 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0d489d60-c244-4596-937f-bc0ccbd5f09b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:59.316683 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0d489d60-c244-4596-937f-bc0ccbd5f09b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:59.317129 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0d489d60-c244-4596-937f-bc0ccbd5f09b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:59.317822 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0d489d60-c244-4596-937f-bc0ccbd5f09b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:59.318279 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0d489d60-c244-4596-937f-bc0ccbd5f09b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:59.318704 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0d489d60-c244-4596-937f-bc0ccbd5f09b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:59.450768 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-0d489d60-c244-4596-937f-bc0ccbd5f09b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:59.459315 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-0d489d60-c244-4596-937f-bc0ccbd5f09b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:59.461035 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-0d489d60-c244-4596-937f-bc0ccbd5f09b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:59.462183 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-0d489d60-c244-4596-937f-bc0ccbd5f09b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1809 microversion: 2.20 time: 0.157380 Sep 25 04:40:59.462736 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 320/585] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:40:59 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:40:59.693719 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-859c7a71-32ac-4ee2-b9e2-a40fef9eb9d4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:40:59.694338 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-859c7a71-32ac-4ee2-b9e2-a40fef9eb9d4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:40:59.701146 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-859c7a71-32ac-4ee2-b9e2-a40fef9eb9d4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:59.701691 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-859c7a71-32ac-4ee2-b9e2-a40fef9eb9d4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:59.702714 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-859c7a71-32ac-4ee2-b9e2-a40fef9eb9d4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:59.703422 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-859c7a71-32ac-4ee2-b9e2-a40fef9eb9d4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:40:59.703880 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-859c7a71-32ac-4ee2-b9e2-a40fef9eb9d4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:40:59.704315 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-859c7a71-32ac-4ee2-b9e2-a40fef9eb9d4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:40:59.831821 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-859c7a71-32ac-4ee2-b9e2-a40fef9eb9d4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:40:59.840199 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-859c7a71-32ac-4ee2-b9e2-a40fef9eb9d4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1734 microversion: 2.1 time: 0.150500 Sep 25 04:40:59.840779 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 266/586] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:40:59 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:00.488367 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-ed5789eb-9dbf-4e63-a1df-301dde9a986f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:00.488995 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-ed5789eb-9dbf-4e63-a1df-301dde9a986f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:00.495815 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ed5789eb-9dbf-4e63-a1df-301dde9a986f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:00.496289 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ed5789eb-9dbf-4e63-a1df-301dde9a986f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:00.496750 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ed5789eb-9dbf-4e63-a1df-301dde9a986f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:00.497420 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ed5789eb-9dbf-4e63-a1df-301dde9a986f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:00.497866 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ed5789eb-9dbf-4e63-a1df-301dde9a986f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:00.498280 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ed5789eb-9dbf-4e63-a1df-301dde9a986f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:00.629974 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-ed5789eb-9dbf-4e63-a1df-301dde9a986f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:00.638476 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-ed5789eb-9dbf-4e63-a1df-301dde9a986f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:00.639935 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-ed5789eb-9dbf-4e63-a1df-301dde9a986f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:00.641096 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-ed5789eb-9dbf-4e63-a1df-301dde9a986f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1809 microversion: 2.20 time: 0.157332 Sep 25 04:41:00.641654 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 321/587] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:41:00 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 04:41:00.865293 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-b92abbd9-bf11-4def-9817-9a038543c081 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:00.865857 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-b92abbd9-bf11-4def-9817-9a038543c081 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:00.872720 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b92abbd9-bf11-4def-9817-9a038543c081 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:00.873208 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b92abbd9-bf11-4def-9817-9a038543c081 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:00.873640 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b92abbd9-bf11-4def-9817-9a038543c081 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:00.874463 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b92abbd9-bf11-4def-9817-9a038543c081 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:00.874907 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b92abbd9-bf11-4def-9817-9a038543c081 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:00.875331 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b92abbd9-bf11-4def-9817-9a038543c081 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:01.002746 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-b92abbd9-bf11-4def-9817-9a038543c081 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:01.010912 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-b92abbd9-bf11-4def-9817-9a038543c081 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1734 microversion: 2.1 time: 0.149562 Sep 25 04:41:01.011465 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 267/588] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:00 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:01.667010 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-3618211e-5258-4d14-a2ba-6347996e8978 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:01.667618 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-3618211e-5258-4d14-a2ba-6347996e8978 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:01.674805 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3618211e-5258-4d14-a2ba-6347996e8978 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:01.675292 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3618211e-5258-4d14-a2ba-6347996e8978 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:01.675732 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3618211e-5258-4d14-a2ba-6347996e8978 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:01.676417 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3618211e-5258-4d14-a2ba-6347996e8978 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:01.676905 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3618211e-5258-4d14-a2ba-6347996e8978 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:01.677332 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3618211e-5258-4d14-a2ba-6347996e8978 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:01.806967 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-3618211e-5258-4d14-a2ba-6347996e8978 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:01.815779 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-3618211e-5258-4d14-a2ba-6347996e8978 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:01.817273 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-3618211e-5258-4d14-a2ba-6347996e8978 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:01.818430 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-3618211e-5258-4d14-a2ba-6347996e8978 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1809 microversion: 2.20 time: 0.155364 Sep 25 04:41:01.818980 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 322/589] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:41:01 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:41:02.035478 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-fe11f13f-0e2d-48bb-a27a-882bf50dfcca tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:02.036032 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-fe11f13f-0e2d-48bb-a27a-882bf50dfcca tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:02.042459 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fe11f13f-0e2d-48bb-a27a-882bf50dfcca tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:02.042956 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fe11f13f-0e2d-48bb-a27a-882bf50dfcca tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:02.043393 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fe11f13f-0e2d-48bb-a27a-882bf50dfcca tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:02.044083 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fe11f13f-0e2d-48bb-a27a-882bf50dfcca tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:02.044542 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fe11f13f-0e2d-48bb-a27a-882bf50dfcca tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:02.044996 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fe11f13f-0e2d-48bb-a27a-882bf50dfcca tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:02.177204 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-fe11f13f-0e2d-48bb-a27a-882bf50dfcca tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:02.185349 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-fe11f13f-0e2d-48bb-a27a-882bf50dfcca tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1734 microversion: 2.1 time: 0.153954 Sep 25 04:41:02.185910 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 268/590] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:02 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:02.845911 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-0284c965-9cbd-4a0c-9d60-ee12612678c2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:02.846450 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-0284c965-9cbd-4a0c-9d60-ee12612678c2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:02.848784 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:41:02.854011 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0284c965-9cbd-4a0c-9d60-ee12612678c2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:02.854495 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0284c965-9cbd-4a0c-9d60-ee12612678c2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:02.854931 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0284c965-9cbd-4a0c-9d60-ee12612678c2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:02.855618 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0284c965-9cbd-4a0c-9d60-ee12612678c2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:02.856093 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0284c965-9cbd-4a0c-9d60-ee12612678c2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:02.856517 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0284c965-9cbd-4a0c-9d60-ee12612678c2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:03.086112 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-0284c965-9cbd-4a0c-9d60-ee12612678c2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:03.098240 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-0284c965-9cbd-4a0c-9d60-ee12612678c2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:03.099616 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-0284c965-9cbd-4a0c-9d60-ee12612678c2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:03.101522 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-0284c965-9cbd-4a0c-9d60-ee12612678c2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1809 microversion: 2.20 time: 0.260232 Sep 25 04:41:03.102126 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 323/591] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:41:02 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1809 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:41:03.209702 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-45df4b66-dbd1-43ef-ac6b-f7fbe85c7ae8 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:03.210314 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-45df4b66-dbd1-43ef-ac6b-f7fbe85c7ae8 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:03.216982 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-45df4b66-dbd1-43ef-ac6b-f7fbe85c7ae8 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:03.217471 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-45df4b66-dbd1-43ef-ac6b-f7fbe85c7ae8 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:03.217908 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-45df4b66-dbd1-43ef-ac6b-f7fbe85c7ae8 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:03.218607 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-45df4b66-dbd1-43ef-ac6b-f7fbe85c7ae8 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:03.219756 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-45df4b66-dbd1-43ef-ac6b-f7fbe85c7ae8 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:03.220187 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-45df4b66-dbd1-43ef-ac6b-f7fbe85c7ae8 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:03.347132 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-45df4b66-dbd1-43ef-ac6b-f7fbe85c7ae8 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:03.356116 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-45df4b66-dbd1-43ef-ac6b-f7fbe85c7ae8 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1734 microversion: 2.1 time: 0.150299 Sep 25 04:41:03.356611 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 269/592] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:03 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:04.128193 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-bb202825-d5cf-4d50-8066-1c8ada2ccda1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:04.128838 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-bb202825-d5cf-4d50-8066-1c8ada2ccda1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:04.135414 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bb202825-d5cf-4d50-8066-1c8ada2ccda1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:04.135902 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bb202825-d5cf-4d50-8066-1c8ada2ccda1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:04.136337 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bb202825-d5cf-4d50-8066-1c8ada2ccda1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:04.137050 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bb202825-d5cf-4d50-8066-1c8ada2ccda1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:04.137511 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bb202825-d5cf-4d50-8066-1c8ada2ccda1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:04.137941 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bb202825-d5cf-4d50-8066-1c8ada2ccda1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:04.267839 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-bb202825-d5cf-4d50-8066-1c8ada2ccda1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:04.276526 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-bb202825-d5cf-4d50-8066-1c8ada2ccda1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:04.278050 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-bb202825-d5cf-4d50-8066-1c8ada2ccda1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:04.279371 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-bb202825-d5cf-4d50-8066-1c8ada2ccda1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1809 microversion: 2.20 time: 0.155827 Sep 25 04:41:04.279923 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 324/593] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:41:04 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:41:04.379969 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-6cd738cd-ea8f-4e28-bae0-b9df37013016 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:04.380603 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-6cd738cd-ea8f-4e28-bae0-b9df37013016 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:04.382965 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_api:SELECT=48 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:41:04.388298 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6cd738cd-ea8f-4e28-bae0-b9df37013016 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:04.388823 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6cd738cd-ea8f-4e28-bae0-b9df37013016 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:04.389263 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6cd738cd-ea8f-4e28-bae0-b9df37013016 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:04.389947 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6cd738cd-ea8f-4e28-bae0-b9df37013016 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:04.390636 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6cd738cd-ea8f-4e28-bae0-b9df37013016 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:04.391106 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6cd738cd-ea8f-4e28-bae0-b9df37013016 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:04.522615 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-6cd738cd-ea8f-4e28-bae0-b9df37013016 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:04.530797 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-6cd738cd-ea8f-4e28-bae0-b9df37013016 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1734 microversion: 2.1 time: 0.155002 Sep 25 04:41:04.531362 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 270/594] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:04 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:05.306408 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-4515315a-e951-4cf8-a30b-196949a5bf63 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:05.307123 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-4515315a-e951-4cf8-a30b-196949a5bf63 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:05.313543 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4515315a-e951-4cf8-a30b-196949a5bf63 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:05.314031 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4515315a-e951-4cf8-a30b-196949a5bf63 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:05.314519 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4515315a-e951-4cf8-a30b-196949a5bf63 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:05.315295 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4515315a-e951-4cf8-a30b-196949a5bf63 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:05.315757 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4515315a-e951-4cf8-a30b-196949a5bf63 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:05.316185 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4515315a-e951-4cf8-a30b-196949a5bf63 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:05.512631 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-4515315a-e951-4cf8-a30b-196949a5bf63 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:05.521403 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-4515315a-e951-4cf8-a30b-196949a5bf63 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:05.522847 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-4515315a-e951-4cf8-a30b-196949a5bf63 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:05.523995 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-4515315a-e951-4cf8-a30b-196949a5bf63 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1809 microversion: 2.20 time: 0.221535 Sep 25 04:41:05.524559 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 325/595] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:41:05 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1809 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:41:05.555098 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-4c37ca57-ee8a-4d67-8001-84ead66c69da tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:05.555701 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-4c37ca57-ee8a-4d67-8001-84ead66c69da tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:05.562076 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4c37ca57-ee8a-4d67-8001-84ead66c69da tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:05.562555 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4c37ca57-ee8a-4d67-8001-84ead66c69da tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:05.562986 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4c37ca57-ee8a-4d67-8001-84ead66c69da tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:05.563666 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4c37ca57-ee8a-4d67-8001-84ead66c69da tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:05.564137 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4c37ca57-ee8a-4d67-8001-84ead66c69da tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:05.565496 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4c37ca57-ee8a-4d67-8001-84ead66c69da tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:05.694696 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-4c37ca57-ee8a-4d67-8001-84ead66c69da tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:05.702971 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-4c37ca57-ee8a-4d67-8001-84ead66c69da tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1734 microversion: 2.1 time: 0.151813 Sep 25 04:41:05.703538 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 271/596] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:05 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:06.552184 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-226826c6-a94b-47b7-9cfa-1f76d642039d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:06.552819 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-226826c6-a94b-47b7-9cfa-1f76d642039d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:06.559214 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-226826c6-a94b-47b7-9cfa-1f76d642039d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:06.559698 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-226826c6-a94b-47b7-9cfa-1f76d642039d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:06.560133 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-226826c6-a94b-47b7-9cfa-1f76d642039d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:06.560841 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-226826c6-a94b-47b7-9cfa-1f76d642039d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:06.561296 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-226826c6-a94b-47b7-9cfa-1f76d642039d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:06.561716 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-226826c6-a94b-47b7-9cfa-1f76d642039d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:06.691335 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-226826c6-a94b-47b7-9cfa-1f76d642039d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:06.700008 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-226826c6-a94b-47b7-9cfa-1f76d642039d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:06.701483 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-226826c6-a94b-47b7-9cfa-1f76d642039d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:06.702653 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-226826c6-a94b-47b7-9cfa-1f76d642039d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1809 microversion: 2.20 time: 0.154496 Sep 25 04:41:06.703225 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 326/597] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:41:06 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:41:06.725733 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-ccccd247-993f-45fc-8320-74512f4f6d40 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:06.726383 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-ccccd247-993f-45fc-8320-74512f4f6d40 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:06.732500 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ccccd247-993f-45fc-8320-74512f4f6d40 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:06.733017 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ccccd247-993f-45fc-8320-74512f4f6d40 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:06.733455 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ccccd247-993f-45fc-8320-74512f4f6d40 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:06.734149 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ccccd247-993f-45fc-8320-74512f4f6d40 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:06.734607 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ccccd247-993f-45fc-8320-74512f4f6d40 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:06.735033 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ccccd247-993f-45fc-8320-74512f4f6d40 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:06.880821 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-ccccd247-993f-45fc-8320-74512f4f6d40 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:06.888996 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-ccccd247-993f-45fc-8320-74512f4f6d40 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1734 microversion: 2.1 time: 0.167040 Sep 25 04:41:06.889556 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 272/598] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:06 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:41:07.729274 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-ae9f54ad-2748-47ab-a5e2-5b5f321f1c9b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:07.729890 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-ae9f54ad-2748-47ab-a5e2-5b5f321f1c9b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:07.736599 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ae9f54ad-2748-47ab-a5e2-5b5f321f1c9b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:07.737106 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ae9f54ad-2748-47ab-a5e2-5b5f321f1c9b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:07.737574 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ae9f54ad-2748-47ab-a5e2-5b5f321f1c9b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:07.739507 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ae9f54ad-2748-47ab-a5e2-5b5f321f1c9b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:07.739676 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ae9f54ad-2748-47ab-a5e2-5b5f321f1c9b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:07.740104 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ae9f54ad-2748-47ab-a5e2-5b5f321f1c9b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:07.912286 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-2b6e1456-7b27-4154-b30a-a7f01f3105c0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:07.912934 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-2b6e1456-7b27-4154-b30a-a7f01f3105c0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:07.919310 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2b6e1456-7b27-4154-b30a-a7f01f3105c0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:07.919793 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2b6e1456-7b27-4154-b30a-a7f01f3105c0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:07.920233 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2b6e1456-7b27-4154-b30a-a7f01f3105c0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:07.920948 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2b6e1456-7b27-4154-b30a-a7f01f3105c0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:07.921409 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2b6e1456-7b27-4154-b30a-a7f01f3105c0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:07.921843 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2b6e1456-7b27-4154-b30a-a7f01f3105c0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:07.929564 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-ae9f54ad-2748-47ab-a5e2-5b5f321f1c9b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:07.938680 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-ae9f54ad-2748-47ab-a5e2-5b5f321f1c9b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:07.940281 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-ae9f54ad-2748-47ab-a5e2-5b5f321f1c9b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:07.942240 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-ae9f54ad-2748-47ab-a5e2-5b5f321f1c9b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1809 microversion: 2.20 time: 0.216177 Sep 25 04:41:07.942828 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 327/599] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:41:07 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1809 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:41:08.053928 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-2b6e1456-7b27-4154-b30a-a7f01f3105c0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:08.062215 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-2b6e1456-7b27-4154-b30a-a7f01f3105c0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1734 microversion: 2.1 time: 0.153926 Sep 25 04:41:08.062780 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 273/600] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:07 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:41:08.967758 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-c9f1c699-7384-459d-b4bc-28b48dca28bc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:08.968365 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-c9f1c699-7384-459d-b4bc-28b48dca28bc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:08.975104 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c9f1c699-7384-459d-b4bc-28b48dca28bc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:08.975584 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c9f1c699-7384-459d-b4bc-28b48dca28bc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:08.976018 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c9f1c699-7384-459d-b4bc-28b48dca28bc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:08.976728 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c9f1c699-7384-459d-b4bc-28b48dca28bc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:08.977182 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c9f1c699-7384-459d-b4bc-28b48dca28bc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:08.977605 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c9f1c699-7384-459d-b4bc-28b48dca28bc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:09.086443 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-11c512aa-9636-4483-9923-06c7f8bf79f7 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:09.087087 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-11c512aa-9636-4483-9923-06c7f8bf79f7 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:09.093486 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-11c512aa-9636-4483-9923-06c7f8bf79f7 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:09.093979 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-11c512aa-9636-4483-9923-06c7f8bf79f7 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:09.094419 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-11c512aa-9636-4483-9923-06c7f8bf79f7 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:09.095114 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-11c512aa-9636-4483-9923-06c7f8bf79f7 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:09.095579 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-11c512aa-9636-4483-9923-06c7f8bf79f7 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:09.096004 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-11c512aa-9636-4483-9923-06c7f8bf79f7 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:09.105771 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-c9f1c699-7384-459d-b4bc-28b48dca28bc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:09.115519 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-c9f1c699-7384-459d-b4bc-28b48dca28bc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:09.117022 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-c9f1c699-7384-459d-b4bc-28b48dca28bc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:09.118191 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-c9f1c699-7384-459d-b4bc-28b48dca28bc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1809 microversion: 2.20 time: 0.154377 Sep 25 04:41:09.118935 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 328/601] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:41:08 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:41:09.234854 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-11c512aa-9636-4483-9923-06c7f8bf79f7 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:09.243850 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-11c512aa-9636-4483-9923-06c7f8bf79f7 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1734 microversion: 2.1 time: 0.162413 Sep 25 04:41:09.244409 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 274/602] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:09 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:41:10.144826 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-02b0b361-0ad2-4041-8bc5-069e4a58bc46 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:10.145605 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-02b0b361-0ad2-4041-8bc5-069e4a58bc46 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:10.151915 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-02b0b361-0ad2-4041-8bc5-069e4a58bc46 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:10.152403 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-02b0b361-0ad2-4041-8bc5-069e4a58bc46 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:10.152888 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-02b0b361-0ad2-4041-8bc5-069e4a58bc46 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:10.153587 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-02b0b361-0ad2-4041-8bc5-069e4a58bc46 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:10.154049 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-02b0b361-0ad2-4041-8bc5-069e4a58bc46 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:10.154479 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-02b0b361-0ad2-4041-8bc5-069e4a58bc46 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:10.267356 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-1544bfd6-5bab-4536-8833-8cd911c09d99 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:10.267901 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-1544bfd6-5bab-4536-8833-8cd911c09d99 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:10.275151 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1544bfd6-5bab-4536-8833-8cd911c09d99 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:10.275636 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1544bfd6-5bab-4536-8833-8cd911c09d99 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:10.276072 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1544bfd6-5bab-4536-8833-8cd911c09d99 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:10.276800 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1544bfd6-5bab-4536-8833-8cd911c09d99 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:10.277257 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1544bfd6-5bab-4536-8833-8cd911c09d99 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:10.277680 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1544bfd6-5bab-4536-8833-8cd911c09d99 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:10.285086 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-02b0b361-0ad2-4041-8bc5-069e4a58bc46 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:10.293992 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-02b0b361-0ad2-4041-8bc5-069e4a58bc46 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:10.295541 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-02b0b361-0ad2-4041-8bc5-069e4a58bc46 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:10.296833 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-02b0b361-0ad2-4041-8bc5-069e4a58bc46 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1809 microversion: 2.20 time: 0.156396 Sep 25 04:41:10.297657 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 329/603] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:41:10 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:41:10.413019 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-1544bfd6-5bab-4536-8833-8cd911c09d99 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:10.421938 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-1544bfd6-5bab-4536-8833-8cd911c09d99 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1714 microversion: 2.1 time: 0.158548 Sep 25 04:41:10.422495 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 275/604] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:10 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1714 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:41:10.485133 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-0b1a0c69-7fe7-425a-a040-a336e1aabeb4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:10.485629 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-0b1a0c69-7fe7-425a-a040-a336e1aabeb4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:10.491705 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0b1a0c69-7fe7-425a-a040-a336e1aabeb4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:10.492189 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0b1a0c69-7fe7-425a-a040-a336e1aabeb4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:10.492650 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0b1a0c69-7fe7-425a-a040-a336e1aabeb4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:10.493335 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0b1a0c69-7fe7-425a-a040-a336e1aabeb4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:10.493782 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0b1a0c69-7fe7-425a-a040-a336e1aabeb4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:10.494203 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0b1a0c69-7fe7-425a-a040-a336e1aabeb4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:10.547705 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=100 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:41:10.623801 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.wsgi [None req-0b1a0c69-7fe7-425a-a040-a336e1aabeb4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] HTTP exception thrown: Cannot 'detach_volume' instance 1348d173-f0db-4d60-94f5-1765387d7294 while it is in vm_state rescued Sep 25 04:41:10.625502 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-0b1a0c69-7fe7-425a-a040-a336e1aabeb4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Request method failure captured: Sep 25 04:41:10.625502 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: request: DELETE /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294/os-volume_attachments/8782e967-ac59-4743-9b18-ab2a004d6ab8 HTTP/1.1 Sep 25 04:41:10.625502 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept: application/json Sep 25 04:41:10.625502 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept-Encoding: identity Sep 25 04:41:10.625502 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Connection: close Sep 25 04:41:10.625502 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Length: 0 Sep 25 04:41:10.625502 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Type: application/json Sep 25 04:41:10.625502 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Host: 10.222.0.25 Sep 25 04:41:10.625502 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Openstack-System-Scope: None Sep 25 04:41:10.625502 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: User-Agent: python-urllib3/1.26.12 Sep 25 04:41:10.625502 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Auth-Token: gAAAAABjL9qqgx9SbwmoscMIXzayDkTaHYe5OsS0R6Y7sMCrDveP0He2ve1AWmZoJjvfku9MDTwEaVSQrNi9P0Yo8NZuEWbmT7VIGNUqGQXykMqiQxqIQpHToYGErquEQDCjI-WfO-ZEE9ccXdKRhNCVIGSYzSyMRRtPFFdQShrVaJWdWp_RDEI Sep 25 04:41:10.625502 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Id: None Sep 25 04:41:10.625502 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Name: None Sep 25 04:41:10.625502 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Identity-Status: Confirmed Sep 25 04:41:10.625502 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Is-Admin-Project: True Sep 25 04:41:10.625502 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Id: default Sep 25 04:41:10.625502 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Name: Default Sep 25 04:41:10.625502 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Id: f6f23cf0323f48069e21acf059cbd1f0 Sep 25 04:41:10.625502 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1236487579 Sep 25 04:41:10.625502 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Role: reader,member Sep 25 04:41:10.625502 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Roles: reader,member Sep 25 04:41:10.627155 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f6f23cf0323f48069e21acf059cbd1f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6f23cf0323f48069e21acf059cbd1f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6f23cf0323f48069e21acf059cbd1f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f6f23cf0323f48069e21acf059cbd1f0"}]}] Sep 25 04:41:10.627155 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1236487579 Sep 25 04:41:10.627155 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Id: f6f23cf0323f48069e21acf059cbd1f0 Sep 25 04:41:10.627155 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1236487579 Sep 25 04:41:10.627155 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User: tempest-ServerRescueNegativeTestJSON-1236487579-project Sep 25 04:41:10.627155 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Id: default Sep 25 04:41:10.627155 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Name: Default Sep 25 04:41:10.627155 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Id: 2666d4774776498bbdbce539296e76a9 Sep 25 04:41:10.627155 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1236487579-project Sep 25 04:41:10.627155 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: method: > Sep 25 04:41:10.627155 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: exception: Cannot 'detach_volume' instance 1348d173-f0db-4d60-94f5-1765387d7294 while it is in vm_state rescued Sep 25 04:41:10.628164 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: action_args: {'server_id': '1348d173-f0db-4d60-94f5-1765387d7294', 'id': '8782e967-ac59-4743-9b18-ab2a004d6ab8'} Sep 25 04:41:10.628164 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:41:10.628164 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:41:10.628164 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 25 04:41:10.628164 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 25 04:41:10.628164 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 25 04:41:10.628164 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 25 04:41:10.628164 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 25 04:41:10.628164 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 25 04:41:10.628164 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1348d173-f0db-4d60-94f5-1765387d7294 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 25 04:41:10.628164 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:41:10.628164 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:41:10.628164 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:41:10.628164 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:41:10.628164 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:41:10.628164 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:41:10.628164 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:41:10.628164 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:41:10.628164 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:41:10.628164 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:41:10.630639 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 25 04:41:10.630639 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 25 04:41:10.630639 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 25 04:41:10.630639 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 25 04:41:10.630639 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 1348d173-f0db-4d60-94f5-1765387d7294 while it is in vm_state rescued Sep 25 04:41:10.630639 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:41:10.630639 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:41:10.630639 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:41:10.630639 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:41:10.630639 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:41:10.630639 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:41:10.630639 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:41:10.630639 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:41:10.630639 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 1348d173-f0db-4d60-94f5-1765387d7294 while it is in vm_state rescued Sep 25 04:41:10.630639 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:41:10.630639 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-0b1a0c69-7fe7-425a-a040-a336e1aabeb4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Returning 409 to user: Cannot 'detach_volume' instance 1348d173-f0db-4d60-94f5-1765387d7294 while it is in vm_state rescued {{(pid=127142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:41:10.632300 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-0b1a0c69-7fe7-425a-a040-a336e1aabeb4 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294/os-volume_attachments/8782e967-ac59-4743-9b18-ab2a004d6ab8" status: 409 len: 152 microversion: 2.1 time: 0.145735 Sep 25 04:41:10.632300 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 330/605] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Sep 25 04:41:10 2022] DELETE /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294/os-volume_attachments/8782e967-ac59-4743-9b18-ab2a004d6ab8 => generated 152 bytes in 147 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 25 04:41:10.638551 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-8df25046-eade-4125-a637-282b7d9fb885 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:41:10.639077 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-8df25046-eade-4125-a637-282b7d9fb885 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:10.644919 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8df25046-eade-4125-a637-282b7d9fb885 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:10.645397 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8df25046-eade-4125-a637-282b7d9fb885 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:10.645833 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8df25046-eade-4125-a637-282b7d9fb885 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:10.646509 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8df25046-eade-4125-a637-282b7d9fb885 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:10.646964 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8df25046-eade-4125-a637-282b7d9fb885 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:10.647386 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8df25046-eade-4125-a637-282b7d9fb885 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:10.716266 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-8df25046-eade-4125-a637-282b7d9fb885 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "POST /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294/action" status: 202 len: 0 microversion: 2.1 time: 0.083098 Sep 25 04:41:10.716928 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 276/606] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 25 04:41:10 2022] POST /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 04:41:10.725196 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-901372d2-9ba6-4e14-825a-d605682545be tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:10.726367 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-901372d2-9ba6-4e14-825a-d605682545be tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:10.732400 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-901372d2-9ba6-4e14-825a-d605682545be tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:10.732947 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-901372d2-9ba6-4e14-825a-d605682545be tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:10.733393 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-901372d2-9ba6-4e14-825a-d605682545be tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:10.734100 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-901372d2-9ba6-4e14-825a-d605682545be tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:10.734557 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-901372d2-9ba6-4e14-825a-d605682545be tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:10.734989 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-901372d2-9ba6-4e14-825a-d605682545be tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:10.864473 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-901372d2-9ba6-4e14-825a-d605682545be tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:10.872857 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-901372d2-9ba6-4e14-825a-d605682545be tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1722 microversion: 2.1 time: 0.151552 Sep 25 04:41:10.873455 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 331/607] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:10 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:11.324308 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-c6bdfaaf-112a-4b34-9fd0-73accf92af7c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:11.325042 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-c6bdfaaf-112a-4b34-9fd0-73accf92af7c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:11.331204 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c6bdfaaf-112a-4b34-9fd0-73accf92af7c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:11.331689 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c6bdfaaf-112a-4b34-9fd0-73accf92af7c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:11.332133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c6bdfaaf-112a-4b34-9fd0-73accf92af7c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:11.332851 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c6bdfaaf-112a-4b34-9fd0-73accf92af7c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:11.333306 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c6bdfaaf-112a-4b34-9fd0-73accf92af7c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:11.333731 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c6bdfaaf-112a-4b34-9fd0-73accf92af7c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:11.349273 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:41:11.468194 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-c6bdfaaf-112a-4b34-9fd0-73accf92af7c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:11.477888 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-c6bdfaaf-112a-4b34-9fd0-73accf92af7c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:11.479330 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-c6bdfaaf-112a-4b34-9fd0-73accf92af7c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:11.480721 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-c6bdfaaf-112a-4b34-9fd0-73accf92af7c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1809 microversion: 2.20 time: 0.161012 Sep 25 04:41:11.481050 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 277/608] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:41:11 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:41:11.898112 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-2fee390b-0091-4f8a-a10b-58f4cffda2de tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:11.898707 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-2fee390b-0091-4f8a-a10b-58f4cffda2de tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:11.905221 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2fee390b-0091-4f8a-a10b-58f4cffda2de tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:11.905703 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2fee390b-0091-4f8a-a10b-58f4cffda2de tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:11.906146 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2fee390b-0091-4f8a-a10b-58f4cffda2de tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:11.906890 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2fee390b-0091-4f8a-a10b-58f4cffda2de tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:11.907342 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2fee390b-0091-4f8a-a10b-58f4cffda2de tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:11.907770 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2fee390b-0091-4f8a-a10b-58f4cffda2de tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:12.038346 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-2fee390b-0091-4f8a-a10b-58f4cffda2de tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:12.046558 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-2fee390b-0091-4f8a-a10b-58f4cffda2de tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1722 microversion: 2.1 time: 0.153107 Sep 25 04:41:12.047117 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 332/609] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:11 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:12.506355 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-0e646563-02c4-4ab3-acdf-3b554fe33640 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:12.507017 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-0e646563-02c4-4ab3-acdf-3b554fe33640 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:12.513464 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0e646563-02c4-4ab3-acdf-3b554fe33640 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:12.513949 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0e646563-02c4-4ab3-acdf-3b554fe33640 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:12.514386 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0e646563-02c4-4ab3-acdf-3b554fe33640 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:12.515069 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0e646563-02c4-4ab3-acdf-3b554fe33640 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:12.515528 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0e646563-02c4-4ab3-acdf-3b554fe33640 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:12.515954 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0e646563-02c4-4ab3-acdf-3b554fe33640 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:12.651204 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-0e646563-02c4-4ab3-acdf-3b554fe33640 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:12.659782 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-0e646563-02c4-4ab3-acdf-3b554fe33640 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:12.661719 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-0e646563-02c4-4ab3-acdf-3b554fe33640 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:12.662897 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-0e646563-02c4-4ab3-acdf-3b554fe33640 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1809 microversion: 2.20 time: 0.160964 Sep 25 04:41:12.663443 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 278/610] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:41:12 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:41:13.070578 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-15328786-d0a9-4c58-8791-5012ff7467ba tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:13.071192 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-15328786-d0a9-4c58-8791-5012ff7467ba tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:13.077568 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-15328786-d0a9-4c58-8791-5012ff7467ba tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:13.078092 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-15328786-d0a9-4c58-8791-5012ff7467ba tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:13.078533 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-15328786-d0a9-4c58-8791-5012ff7467ba tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:13.079223 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-15328786-d0a9-4c58-8791-5012ff7467ba tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:13.079679 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-15328786-d0a9-4c58-8791-5012ff7467ba tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:13.080108 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-15328786-d0a9-4c58-8791-5012ff7467ba tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:13.302310 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-15328786-d0a9-4c58-8791-5012ff7467ba tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:13.310843 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-15328786-d0a9-4c58-8791-5012ff7467ba tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1722 microversion: 2.1 time: 0.244739 Sep 25 04:41:13.311616 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 333/611] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:13 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:13.687470 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-9f12807d-691c-4494-ade9-4b54f0800f1a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:13.688079 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-9f12807d-691c-4494-ade9-4b54f0800f1a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:13.694808 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9f12807d-691c-4494-ade9-4b54f0800f1a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:13.695292 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9f12807d-691c-4494-ade9-4b54f0800f1a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:13.695730 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9f12807d-691c-4494-ade9-4b54f0800f1a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:13.696417 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9f12807d-691c-4494-ade9-4b54f0800f1a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:13.696902 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9f12807d-691c-4494-ade9-4b54f0800f1a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:13.697331 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9f12807d-691c-4494-ade9-4b54f0800f1a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:13.825280 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-9f12807d-691c-4494-ade9-4b54f0800f1a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:13.834484 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-9f12807d-691c-4494-ade9-4b54f0800f1a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:13.836189 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-9f12807d-691c-4494-ade9-4b54f0800f1a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:13.837388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-9f12807d-691c-4494-ade9-4b54f0800f1a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1809 microversion: 2.20 time: 0.153969 Sep 25 04:41:13.837955 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 279/612] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:41:13 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:41:14.334743 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-d09abd16-918c-4be0-a0be-4e19d3152e43 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:14.335402 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-d09abd16-918c-4be0-a0be-4e19d3152e43 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:14.342172 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d09abd16-918c-4be0-a0be-4e19d3152e43 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:14.342658 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d09abd16-918c-4be0-a0be-4e19d3152e43 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:14.343100 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d09abd16-918c-4be0-a0be-4e19d3152e43 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:14.343797 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d09abd16-918c-4be0-a0be-4e19d3152e43 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:14.344254 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d09abd16-918c-4be0-a0be-4e19d3152e43 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:14.344706 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d09abd16-918c-4be0-a0be-4e19d3152e43 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:14.476598 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-d09abd16-918c-4be0-a0be-4e19d3152e43 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:14.484771 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-d09abd16-918c-4be0-a0be-4e19d3152e43 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1722 microversion: 2.1 time: 0.154673 Sep 25 04:41:14.485329 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 334/613] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:14 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:14.863042 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-4ba7dc96-20f7-4d14-87b4-bfd31bb240e8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:14.864438 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-4ba7dc96-20f7-4d14-87b4-bfd31bb240e8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:14.872793 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4ba7dc96-20f7-4d14-87b4-bfd31bb240e8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:14.873578 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4ba7dc96-20f7-4d14-87b4-bfd31bb240e8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:14.874165 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4ba7dc96-20f7-4d14-87b4-bfd31bb240e8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:14.874863 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4ba7dc96-20f7-4d14-87b4-bfd31bb240e8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:14.875323 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4ba7dc96-20f7-4d14-87b4-bfd31bb240e8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:14.875746 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4ba7dc96-20f7-4d14-87b4-bfd31bb240e8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:15.003814 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-4ba7dc96-20f7-4d14-87b4-bfd31bb240e8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:15.013722 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-4ba7dc96-20f7-4d14-87b4-bfd31bb240e8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:15.015151 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-4ba7dc96-20f7-4d14-87b4-bfd31bb240e8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:15.016295 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-4ba7dc96-20f7-4d14-87b4-bfd31bb240e8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1809 microversion: 2.20 time: 0.157343 Sep 25 04:41:15.016886 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 280/614] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:41:14 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:41:15.508631 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-900a4867-aeb1-4ded-8478-3cf7e7f01967 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:15.509293 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-900a4867-aeb1-4ded-8478-3cf7e7f01967 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:15.515659 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-900a4867-aeb1-4ded-8478-3cf7e7f01967 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:15.516144 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-900a4867-aeb1-4ded-8478-3cf7e7f01967 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:15.516583 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-900a4867-aeb1-4ded-8478-3cf7e7f01967 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:15.517326 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-900a4867-aeb1-4ded-8478-3cf7e7f01967 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:15.517780 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-900a4867-aeb1-4ded-8478-3cf7e7f01967 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:15.518203 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-900a4867-aeb1-4ded-8478-3cf7e7f01967 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:15.650383 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-900a4867-aeb1-4ded-8478-3cf7e7f01967 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:15.658624 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-900a4867-aeb1-4ded-8478-3cf7e7f01967 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1722 microversion: 2.1 time: 0.153801 Sep 25 04:41:15.659188 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 335/615] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:15 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:15.991640 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [req-2a82ab7d-9b5e-4f4f-991c-de015a17fef9 req-741d6653-5a94-4b46-b431-88edb2f5e01b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9e99419-ae76-4d84-9e7a-d0a31530ea14", "name": "network-vif-plugged", "status": "completed", "tag": "28807ae7-bb46-4e31-93d7-48170864edca"}]} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:41:16.001743 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-2a82ab7d-9b5e-4f4f-991c-de015a17fef9 req-741d6653-5a94-4b46-b431-88edb2f5e01b service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:16.002217 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-2a82ab7d-9b5e-4f4f-991c-de015a17fef9 req-741d6653-5a94-4b46-b431-88edb2f5e01b service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:16.002698 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-2a82ab7d-9b5e-4f4f-991c-de015a17fef9 req-741d6653-5a94-4b46-b431-88edb2f5e01b service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:16.014760 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.compute.server_external_events [req-2a82ab7d-9b5e-4f4f-991c-de015a17fef9 req-741d6653-5a94-4b46-b431-88edb2f5e01b service nova] Creating event network-vif-plugged:28807ae7-bb46-4e31-93d7-48170864edca for instance c9e99419-ae76-4d84-9e7a-d0a31530ea14 on hv-cinder-85535 Sep 25 04:41:16.020357 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [req-2a82ab7d-9b5e-4f4f-991c-de015a17fef9 req-741d6653-5a94-4b46-b431-88edb2f5e01b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032408 Sep 25 04:41:16.021144 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 281/616] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:41:16.041977 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-0a8164cf-b4fe-4c01-8ee4-6e7fcf69221d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:16.042717 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-0a8164cf-b4fe-4c01-8ee4-6e7fcf69221d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:16.048677 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0a8164cf-b4fe-4c01-8ee4-6e7fcf69221d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:16.049236 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0a8164cf-b4fe-4c01-8ee4-6e7fcf69221d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:16.049764 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0a8164cf-b4fe-4c01-8ee4-6e7fcf69221d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:16.050615 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0a8164cf-b4fe-4c01-8ee4-6e7fcf69221d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:16.051136 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0a8164cf-b4fe-4c01-8ee4-6e7fcf69221d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:16.051636 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0a8164cf-b4fe-4c01-8ee4-6e7fcf69221d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:16.178282 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-0a8164cf-b4fe-4c01-8ee4-6e7fcf69221d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:16.186870 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-0a8164cf-b4fe-4c01-8ee4-6e7fcf69221d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:16.188307 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-0a8164cf-b4fe-4c01-8ee4-6e7fcf69221d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:16.189495 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-0a8164cf-b4fe-4c01-8ee4-6e7fcf69221d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1809 microversion: 2.20 time: 0.151537 Sep 25 04:41:16.190046 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 336/617] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:41:16 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:41:16.683574 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-d23ea12c-52de-4bd1-906f-def147faca7c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:16.684329 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-d23ea12c-52de-4bd1-906f-def147faca7c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:16.690470 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d23ea12c-52de-4bd1-906f-def147faca7c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:16.690953 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d23ea12c-52de-4bd1-906f-def147faca7c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:16.692049 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d23ea12c-52de-4bd1-906f-def147faca7c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:16.692769 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d23ea12c-52de-4bd1-906f-def147faca7c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:16.693223 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d23ea12c-52de-4bd1-906f-def147faca7c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:16.693651 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d23ea12c-52de-4bd1-906f-def147faca7c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:16.823169 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-d23ea12c-52de-4bd1-906f-def147faca7c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:16.831353 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-d23ea12c-52de-4bd1-906f-def147faca7c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1722 microversion: 2.1 time: 0.152187 Sep 25 04:41:16.831930 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 282/618] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:16 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:17.215935 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-b4035512-2d8a-41e7-9df9-a76641be09d6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:17.216541 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-b4035512-2d8a-41e7-9df9-a76641be09d6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:17.223675 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b4035512-2d8a-41e7-9df9-a76641be09d6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:17.224152 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b4035512-2d8a-41e7-9df9-a76641be09d6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:17.224588 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b4035512-2d8a-41e7-9df9-a76641be09d6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:17.225296 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b4035512-2d8a-41e7-9df9-a76641be09d6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:17.225748 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b4035512-2d8a-41e7-9df9-a76641be09d6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:17.226168 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b4035512-2d8a-41e7-9df9-a76641be09d6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:17.355280 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-b4035512-2d8a-41e7-9df9-a76641be09d6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:17.364360 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-b4035512-2d8a-41e7-9df9-a76641be09d6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:17.365851 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-b4035512-2d8a-41e7-9df9-a76641be09d6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:17.366998 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-b4035512-2d8a-41e7-9df9-a76641be09d6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1809 microversion: 2.20 time: 0.154959 Sep 25 04:41:17.367551 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 337/619] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:41:17 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:41:17.854546 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-9e5e4350-92e2-4b42-a04a-9c6fbd0d2a1b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:17.855147 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-9e5e4350-92e2-4b42-a04a-9c6fbd0d2a1b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:17.861491 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9e5e4350-92e2-4b42-a04a-9c6fbd0d2a1b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:17.862002 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9e5e4350-92e2-4b42-a04a-9c6fbd0d2a1b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:17.862435 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9e5e4350-92e2-4b42-a04a-9c6fbd0d2a1b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:17.863215 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9e5e4350-92e2-4b42-a04a-9c6fbd0d2a1b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:17.863864 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9e5e4350-92e2-4b42-a04a-9c6fbd0d2a1b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:17.864291 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9e5e4350-92e2-4b42-a04a-9c6fbd0d2a1b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:17.990393 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-9e5e4350-92e2-4b42-a04a-9c6fbd0d2a1b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:17.998607 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-9e5e4350-92e2-4b42-a04a-9c6fbd0d2a1b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1728 microversion: 2.1 time: 0.147873 Sep 25 04:41:17.999177 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 283/620] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:17 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:18.022841 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-6e44444b-7322-4af5-86d5-3c90d8e8f4a8 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:18.023335 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-6e44444b-7322-4af5-86d5-3c90d8e8f4a8 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:18.030512 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6e44444b-7322-4af5-86d5-3c90d8e8f4a8 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:18.030512 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6e44444b-7322-4af5-86d5-3c90d8e8f4a8 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:18.030512 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6e44444b-7322-4af5-86d5-3c90d8e8f4a8 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:18.031130 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6e44444b-7322-4af5-86d5-3c90d8e8f4a8 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:18.031583 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6e44444b-7322-4af5-86d5-3c90d8e8f4a8 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:18.032008 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6e44444b-7322-4af5-86d5-3c90d8e8f4a8 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:18.107869 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-6e44444b-7322-4af5-86d5-3c90d8e8f4a8 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089746 Sep 25 04:41:18.108489 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 338/621] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Sep 25 04:41:18 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:41:18.391750 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-d522cd06-b86f-4107-9ff0-e29afa279cd9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:18.392854 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-d522cd06-b86f-4107-9ff0-e29afa279cd9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:18.399652 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d522cd06-b86f-4107-9ff0-e29afa279cd9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:18.400168 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d522cd06-b86f-4107-9ff0-e29afa279cd9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:18.400609 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d522cd06-b86f-4107-9ff0-e29afa279cd9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:18.401341 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d522cd06-b86f-4107-9ff0-e29afa279cd9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:18.401799 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d522cd06-b86f-4107-9ff0-e29afa279cd9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:18.402223 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d522cd06-b86f-4107-9ff0-e29afa279cd9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:18.871091 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-d522cd06-b86f-4107-9ff0-e29afa279cd9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:18.880516 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-d522cd06-b86f-4107-9ff0-e29afa279cd9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:18.882615 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-d522cd06-b86f-4107-9ff0-e29afa279cd9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:18.883347 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-d522cd06-b86f-4107-9ff0-e29afa279cd9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1809 microversion: 2.20 time: 0.495933 Sep 25 04:41:18.883906 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 284/622] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:41:18 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1809 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:41:19.426864 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-3496373b-83d7-44f1-beb2-a154180b5f8c req-57cfff93-8fc3-455d-bfcb-6f420aa02ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1348d173-f0db-4d60-94f5-1765387d7294", "tag": "200b52b7-c7da-4e8b-924a-5151390b5778"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:41:19.436363 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-3496373b-83d7-44f1-beb2-a154180b5f8c req-57cfff93-8fc3-455d-bfcb-6f420aa02ed4 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:19.436875 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-3496373b-83d7-44f1-beb2-a154180b5f8c req-57cfff93-8fc3-455d-bfcb-6f420aa02ed4 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:19.437302 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-3496373b-83d7-44f1-beb2-a154180b5f8c req-57cfff93-8fc3-455d-bfcb-6f420aa02ed4 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:19.448650 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-3496373b-83d7-44f1-beb2-a154180b5f8c req-57cfff93-8fc3-455d-bfcb-6f420aa02ed4 service nova] Creating event network-changed:200b52b7-c7da-4e8b-924a-5151390b5778 for instance 1348d173-f0db-4d60-94f5-1765387d7294 on hv-cinder-85535 Sep 25 04:41:19.453902 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-3496373b-83d7-44f1-beb2-a154180b5f8c req-57cfff93-8fc3-455d-bfcb-6f420aa02ed4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102283 Sep 25 04:41:19.454499 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 339/623] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:41:19.805623 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-a5f7e0b8-a1b1-4f4b-a268-4f71985947d4 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:19.806118 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-a5f7e0b8-a1b1-4f4b-a268-4f71985947d4 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: d6138f3e-a927-4d61-890c-ccd60213e4f2] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:19.812792 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a5f7e0b8-a1b1-4f4b-a268-4f71985947d4 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:19.813280 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a5f7e0b8-a1b1-4f4b-a268-4f71985947d4 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:19.813716 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a5f7e0b8-a1b1-4f4b-a268-4f71985947d4 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:19.814413 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a5f7e0b8-a1b1-4f4b-a268-4f71985947d4 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:19.814872 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a5f7e0b8-a1b1-4f4b-a268-4f71985947d4 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:19.815296 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a5f7e0b8-a1b1-4f4b-a268-4f71985947d4 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:19.841341 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-a5f7e0b8-a1b1-4f4b-a268-4f71985947d4 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: d6138f3e-a927-4d61-890c-ccd60213e4f2] Going to try to terminate instance {{(pid=127141) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 04:41:19.912130 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-14ee2b01-62ad-49be-a7e3-238aea13e1af tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:19.912895 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-14ee2b01-62ad-49be-a7e3-238aea13e1af tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:19.919357 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-14ee2b01-62ad-49be-a7e3-238aea13e1af tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:19.919936 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-14ee2b01-62ad-49be-a7e3-238aea13e1af tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:19.920494 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-14ee2b01-62ad-49be-a7e3-238aea13e1af tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:19.921653 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-14ee2b01-62ad-49be-a7e3-238aea13e1af tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:19.922332 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-14ee2b01-62ad-49be-a7e3-238aea13e1af tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:19.922969 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-14ee2b01-62ad-49be-a7e3-238aea13e1af tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:19.926163 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-a5f7e0b8-a1b1-4f4b-a268-4f71985947d4 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2" status: 204 len: 0 microversion: 2.1 time: 0.124003 Sep 25 04:41:19.929986 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 285/624] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 25 04:41:19 2022] DELETE /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 25 04:41:19.938028 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-fbcdb5e7-81a9-4f1c-bfb2-6d655e3dae24 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:19.938722 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-fbcdb5e7-81a9-4f1c-bfb2-6d655e3dae24 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: d6138f3e-a927-4d61-890c-ccd60213e4f2] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:19.945505 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fbcdb5e7-81a9-4f1c-bfb2-6d655e3dae24 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:19.945995 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fbcdb5e7-81a9-4f1c-bfb2-6d655e3dae24 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:19.946429 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fbcdb5e7-81a9-4f1c-bfb2-6d655e3dae24 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:19.947123 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fbcdb5e7-81a9-4f1c-bfb2-6d655e3dae24 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:19.947575 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fbcdb5e7-81a9-4f1c-bfb2-6d655e3dae24 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:19.948004 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fbcdb5e7-81a9-4f1c-bfb2-6d655e3dae24 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:20.143813 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-14ee2b01-62ad-49be-a7e3-238aea13e1af tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:20.163502 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-fbcdb5e7-81a9-4f1c-bfb2-6d655e3dae24 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:20.170164 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-14ee2b01-62ad-49be-a7e3-238aea13e1af tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:20.171627 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-14ee2b01-62ad-49be-a7e3-238aea13e1af tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:20.172861 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-14ee2b01-62ad-49be-a7e3-238aea13e1af tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1809 microversion: 2.20 time: 0.265688 Sep 25 04:41:20.175117 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 340/625] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:41:19 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1809 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 04:41:20.179116 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-fbcdb5e7-81a9-4f1c-bfb2-6d655e3dae24 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2" status: 200 len: 1577 microversion: 2.1 time: 0.244563 Sep 25 04:41:20.179962 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 286/626] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:19 2022] GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2 => generated 1577 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:21.200476 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-b5d83215-50ce-47bf-b086-bb5e7298553e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:21.201091 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-b5d83215-50ce-47bf-b086-bb5e7298553e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:21.203500 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-731e234e-e16b-444e-9459-b776a7665e7e tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:21.204144 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-731e234e-e16b-444e-9459-b776a7665e7e tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: d6138f3e-a927-4d61-890c-ccd60213e4f2] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:21.207970 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b5d83215-50ce-47bf-b086-bb5e7298553e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:21.208449 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b5d83215-50ce-47bf-b086-bb5e7298553e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:21.208904 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b5d83215-50ce-47bf-b086-bb5e7298553e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:21.209689 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b5d83215-50ce-47bf-b086-bb5e7298553e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:21.210492 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b5d83215-50ce-47bf-b086-bb5e7298553e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:21.211357 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b5d83215-50ce-47bf-b086-bb5e7298553e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:21.211479 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-731e234e-e16b-444e-9459-b776a7665e7e tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:21.211957 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-731e234e-e16b-444e-9459-b776a7665e7e tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:21.212393 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-731e234e-e16b-444e-9459-b776a7665e7e tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:21.213110 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-731e234e-e16b-444e-9459-b776a7665e7e tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:21.213569 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-731e234e-e16b-444e-9459-b776a7665e7e tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:21.214091 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-731e234e-e16b-444e-9459-b776a7665e7e tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:21.412404 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-b5d83215-50ce-47bf-b086-bb5e7298553e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:21.415831 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-731e234e-e16b-444e-9459-b776a7665e7e tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:21.421218 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-b5d83215-50ce-47bf-b086-bb5e7298553e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:21.422750 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-b5d83215-50ce-47bf-b086-bb5e7298553e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:21.423453 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-731e234e-e16b-444e-9459-b776a7665e7e tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2" status: 200 len: 1577 microversion: 2.1 time: 0.224244 Sep 25 04:41:21.424013 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 287/627] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:21 2022] GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2 => generated 1577 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:41:21.424122 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-b5d83215-50ce-47bf-b086-bb5e7298553e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1809 microversion: 2.20 time: 0.227594 Sep 25 04:41:21.424847 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 341/628] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:41:21 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1809 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:41:21.468676 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [req-d029ac1c-8401-4377-a06d-542df98619f7 req-1627fad6-7986-4c2e-a19d-bb89a1e474aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1348d173-f0db-4d60-94f5-1765387d7294", "tag": "200b52b7-c7da-4e8b-924a-5151390b5778"}]} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:41:21.479109 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-d029ac1c-8401-4377-a06d-542df98619f7 req-1627fad6-7986-4c2e-a19d-bb89a1e474aa service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:21.479597 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-d029ac1c-8401-4377-a06d-542df98619f7 req-1627fad6-7986-4c2e-a19d-bb89a1e474aa service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:21.480031 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-d029ac1c-8401-4377-a06d-542df98619f7 req-1627fad6-7986-4c2e-a19d-bb89a1e474aa service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:21.493188 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.compute.server_external_events [req-d029ac1c-8401-4377-a06d-542df98619f7 req-1627fad6-7986-4c2e-a19d-bb89a1e474aa service nova] Creating event network-changed:200b52b7-c7da-4e8b-924a-5151390b5778 for instance 1348d173-f0db-4d60-94f5-1765387d7294 on hv-cinder-85535 Sep 25 04:41:21.498208 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [req-d029ac1c-8401-4377-a06d-542df98619f7 req-1627fad6-7986-4c2e-a19d-bb89a1e474aa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033123 Sep 25 04:41:21.498777 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 288/629] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:41:22.446972 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-1fa45190-b93a-4038-a529-4d78e31b9710 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:22.447578 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-1fa45190-b93a-4038-a529-4d78e31b9710 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: d6138f3e-a927-4d61-890c-ccd60213e4f2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:22.451553 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-1c124843-2680-40c8-b09d-660742c38fd0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:22.452309 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-1c124843-2680-40c8-b09d-660742c38fd0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:22.454211 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1fa45190-b93a-4038-a529-4d78e31b9710 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:22.454698 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1fa45190-b93a-4038-a529-4d78e31b9710 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:22.455141 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1fa45190-b93a-4038-a529-4d78e31b9710 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:22.455834 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1fa45190-b93a-4038-a529-4d78e31b9710 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:22.456289 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1fa45190-b93a-4038-a529-4d78e31b9710 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:22.457490 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1fa45190-b93a-4038-a529-4d78e31b9710 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:22.459411 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1c124843-2680-40c8-b09d-660742c38fd0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:22.459897 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1c124843-2680-40c8-b09d-660742c38fd0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:22.460331 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1c124843-2680-40c8-b09d-660742c38fd0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:22.461322 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1c124843-2680-40c8-b09d-660742c38fd0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:22.461777 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1c124843-2680-40c8-b09d-660742c38fd0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:22.462200 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1c124843-2680-40c8-b09d-660742c38fd0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:22.655209 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-1fa45190-b93a-4038-a529-4d78e31b9710 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:22.663174 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-1fa45190-b93a-4038-a529-4d78e31b9710 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2" status: 200 len: 1577 microversion: 2.1 time: 0.220000 Sep 25 04:41:22.664183 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 342/630] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:22 2022] GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2 => generated 1577 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:22.667059 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-1c124843-2680-40c8-b09d-660742c38fd0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:22.677985 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-1c124843-2680-40c8-b09d-660742c38fd0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:22.679905 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-1c124843-2680-40c8-b09d-660742c38fd0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:22.681106 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-1c124843-2680-40c8-b09d-660742c38fd0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1809 microversion: 2.20 time: 0.233697 Sep 25 04:41:22.681652 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 289/631] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:41:22 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1809 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 04:41:23.686925 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-64b6b379-60f9-4653-9391-0076d7c1decd tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:23.687596 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-64b6b379-60f9-4653-9391-0076d7c1decd tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: d6138f3e-a927-4d61-890c-ccd60213e4f2] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:23.695535 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-64b6b379-60f9-4653-9391-0076d7c1decd tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:23.696127 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-64b6b379-60f9-4653-9391-0076d7c1decd tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:23.696827 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-64b6b379-60f9-4653-9391-0076d7c1decd tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:23.697595 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-64b6b379-60f9-4653-9391-0076d7c1decd tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:23.698115 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-64b6b379-60f9-4653-9391-0076d7c1decd tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:23.698856 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-64b6b379-60f9-4653-9391-0076d7c1decd tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:23.720471 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-b700d6c1-ab4d-40d2-be61-0c26717b076a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:23.721062 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-b700d6c1-ab4d-40d2-be61-0c26717b076a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:23.729000 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b700d6c1-ab4d-40d2-be61-0c26717b076a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:23.731201 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b700d6c1-ab4d-40d2-be61-0c26717b076a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:23.731964 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b700d6c1-ab4d-40d2-be61-0c26717b076a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:23.732929 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b700d6c1-ab4d-40d2-be61-0c26717b076a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:23.733583 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b700d6c1-ab4d-40d2-be61-0c26717b076a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:23.734444 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b700d6c1-ab4d-40d2-be61-0c26717b076a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:23.829953 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.objects.instance [None req-b700d6c1-ab4d-40d2-be61-0c26717b076a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lazy-loading 'services' on Instance uuid c9be0143-7c91-4fba-8c2c-500f01573632 {{(pid=127142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 04:41:23.949252 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-b700d6c1-ab4d-40d2-be61-0c26717b076a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632/os-volume_attachments/898d3f9f-1812-4126-8381-0d77e1c21571" status: 202 len: 0 microversion: 2.1 time: 0.339349 Sep 25 04:41:23.949963 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 343/632] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Sep 25 04:41:23 2022] DELETE /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632/os-volume_attachments/898d3f9f-1812-4126-8381-0d77e1c21571 => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 04:41:23.956278 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-ff39652e-7f39-4dcd-9c2c-820d4bfcd3da tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:23.957237 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-ff39652e-7f39-4dcd-9c2c-820d4bfcd3da tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:23.964810 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ff39652e-7f39-4dcd-9c2c-820d4bfcd3da tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:23.965637 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ff39652e-7f39-4dcd-9c2c-820d4bfcd3da tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:23.966075 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ff39652e-7f39-4dcd-9c2c-820d4bfcd3da tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:23.966893 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ff39652e-7f39-4dcd-9c2c-820d4bfcd3da tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:23.967543 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ff39652e-7f39-4dcd-9c2c-820d4bfcd3da tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:23.967997 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ff39652e-7f39-4dcd-9c2c-820d4bfcd3da tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:24.156682 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-64b6b379-60f9-4653-9391-0076d7c1decd tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:24.165652 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-64b6b379-60f9-4653-9391-0076d7c1decd tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2" status: 200 len: 1577 microversion: 2.1 time: 0.482558 Sep 25 04:41:24.166222 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 290/633] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:23 2022] GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2 => generated 1577 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:41:24.295115 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-ff39652e-7f39-4dcd-9c2c-820d4bfcd3da tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:24.304421 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-ff39652e-7f39-4dcd-9c2c-820d4bfcd3da tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:24.305919 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-ff39652e-7f39-4dcd-9c2c-820d4bfcd3da tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:24.307091 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-ff39652e-7f39-4dcd-9c2c-820d4bfcd3da tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1796 microversion: 2.20 time: 0.356025 Sep 25 04:41:24.307655 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 344/634] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:41:23 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1796 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:41:25.053276 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [req-b5312353-f515-49bc-92ba-01f5d07f5572 req-4039f430-af6f-4483-8d65-a6b1d4a9ad4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6138f3e-a927-4d61-890c-ccd60213e4f2", "name": "network-vif-deleted", "tag": "9bd5cc76-3974-4656-ab0e-c104227f5d9c"}]} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:41:25.074693 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-b5312353-f515-49bc-92ba-01f5d07f5572 req-4039f430-af6f-4483-8d65-a6b1d4a9ad4b service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:25.078689 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-b5312353-f515-49bc-92ba-01f5d07f5572 req-4039f430-af6f-4483-8d65-a6b1d4a9ad4b service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:25.079159 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-b5312353-f515-49bc-92ba-01f5d07f5572 req-4039f430-af6f-4483-8d65-a6b1d4a9ad4b service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:25.119858 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.compute.server_external_events [req-b5312353-f515-49bc-92ba-01f5d07f5572 req-4039f430-af6f-4483-8d65-a6b1d4a9ad4b service nova] Creating event network-vif-deleted:9bd5cc76-3974-4656-ab0e-c104227f5d9c for instance d6138f3e-a927-4d61-890c-ccd60213e4f2 on hv-cinder-85535 Sep 25 04:41:25.138477 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [req-b5312353-f515-49bc-92ba-01f5d07f5572 req-4039f430-af6f-4483-8d65-a6b1d4a9ad4b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090335 Sep 25 04:41:25.139019 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 291/635] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:41:25.193061 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-7808cf5e-f3f5-4405-b68b-a4a83df0b1aa tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:25.193061 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-7808cf5e-f3f5-4405-b68b-a4a83df0b1aa tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: d6138f3e-a927-4d61-890c-ccd60213e4f2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:25.198113 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7808cf5e-f3f5-4405-b68b-a4a83df0b1aa tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:25.198604 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7808cf5e-f3f5-4405-b68b-a4a83df0b1aa tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:25.199117 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7808cf5e-f3f5-4405-b68b-a4a83df0b1aa tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:25.199815 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7808cf5e-f3f5-4405-b68b-a4a83df0b1aa tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:25.200395 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7808cf5e-f3f5-4405-b68b-a4a83df0b1aa tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:25.200933 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7808cf5e-f3f5-4405-b68b-a4a83df0b1aa tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:25.290252 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-7808cf5e-f3f5-4405-b68b-a4a83df0b1aa tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:25.298118 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-7808cf5e-f3f5-4405-b68b-a4a83df0b1aa tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2" status: 200 len: 1224 microversion: 2.1 time: 0.111979 Sep 25 04:41:25.313078 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 345/636] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:25 2022] GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2 => generated 1224 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:26.201080 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-9f4c0c37-7241-4625-99ef-7de7c824fe31 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:41:26.208393 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9f4c0c37-7241-4625-99ef-7de7c824fe31 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:26.208916 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9f4c0c37-7241-4625-99ef-7de7c824fe31 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:26.209350 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9f4c0c37-7241-4625-99ef-7de7c824fe31 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:26.272098 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-9f4c0c37-7241-4625-99ef-7de7c824fe31 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Going to try to stop instance {{(pid=127141) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 25 04:41:26.322028 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-7c450baa-1dd5-4be6-8244-6f83fbfb8306 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:26.322684 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-7c450baa-1dd5-4be6-8244-6f83fbfb8306 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: d6138f3e-a927-4d61-890c-ccd60213e4f2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:26.323516 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-9f4c0c37-7241-4625-99ef-7de7c824fe31 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "POST /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632/action" status: 202 len: 0 microversion: 2.1 time: 0.126724 Sep 25 04:41:26.324937 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 292/637] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 25 04:41:26 2022] POST /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 04:41:26.329828 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7c450baa-1dd5-4be6-8244-6f83fbfb8306 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:26.330465 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7c450baa-1dd5-4be6-8244-6f83fbfb8306 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:26.330974 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7c450baa-1dd5-4be6-8244-6f83fbfb8306 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:26.331898 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7c450baa-1dd5-4be6-8244-6f83fbfb8306 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:26.332694 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7c450baa-1dd5-4be6-8244-6f83fbfb8306 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:26.333197 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7c450baa-1dd5-4be6-8244-6f83fbfb8306 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:26.333970 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-6c8aa428-d545-4cd7-a0ab-4d5ce51680f3 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:26.334695 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-6c8aa428-d545-4cd7-a0ab-4d5ce51680f3 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:26.342992 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6c8aa428-d545-4cd7-a0ab-4d5ce51680f3 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:26.343476 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6c8aa428-d545-4cd7-a0ab-4d5ce51680f3 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:26.343972 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6c8aa428-d545-4cd7-a0ab-4d5ce51680f3 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:26.344626 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6c8aa428-d545-4cd7-a0ab-4d5ce51680f3 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:26.345111 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6c8aa428-d545-4cd7-a0ab-4d5ce51680f3 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:26.345544 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6c8aa428-d545-4cd7-a0ab-4d5ce51680f3 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:26.363623 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:41:26.369854 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7c450baa-1dd5-4be6-8244-6f83fbfb8306 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:26.370415 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7c450baa-1dd5-4be6-8244-6f83fbfb8306 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:26.370915 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7c450baa-1dd5-4be6-8244-6f83fbfb8306 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:26.371427 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.objects.instance [None req-7c450baa-1dd5-4be6-8244-6f83fbfb8306 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lazy-loading 'fault' on Instance uuid d6138f3e-a927-4d61-890c-ccd60213e4f2 {{(pid=127142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 04:41:26.430044 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-7c450baa-1dd5-4be6-8244-6f83fbfb8306 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:26.439794 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-7c450baa-1dd5-4be6-8244-6f83fbfb8306 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2" status: 200 len: 1183 microversion: 2.1 time: 0.121688 Sep 25 04:41:26.447622 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 346/638] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:26 2022] GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2 => generated 1183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:26.524536 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-6c8aa428-d545-4cd7-a0ab-4d5ce51680f3 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:26.532410 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-6c8aa428-d545-4cd7-a0ab-4d5ce51680f3 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1680 microversion: 2.1 time: 0.202718 Sep 25 04:41:26.533003 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 293/639] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:26 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1680 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:27.463971 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-c8b1da2d-4ee7-410f-a3a6-9ff85c170a65 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:27.464499 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-c8b1da2d-4ee7-410f-a3a6-9ff85c170a65 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: d6138f3e-a927-4d61-890c-ccd60213e4f2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:27.471128 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c8b1da2d-4ee7-410f-a3a6-9ff85c170a65 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:27.471617 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c8b1da2d-4ee7-410f-a3a6-9ff85c170a65 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:27.472738 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c8b1da2d-4ee7-410f-a3a6-9ff85c170a65 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:27.473512 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c8b1da2d-4ee7-410f-a3a6-9ff85c170a65 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:27.473971 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c8b1da2d-4ee7-410f-a3a6-9ff85c170a65 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:27.474403 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c8b1da2d-4ee7-410f-a3a6-9ff85c170a65 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:27.477213 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:41:27.491592 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.wsgi [None req-c8b1da2d-4ee7-410f-a3a6-9ff85c170a65 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] HTTP exception thrown: Instance d6138f3e-a927-4d61-890c-ccd60213e4f2 could not be found. Sep 25 04:41:27.493862 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-c8b1da2d-4ee7-410f-a3a6-9ff85c170a65 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Request method failure captured: Sep 25 04:41:27.493862 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: request: GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2 HTTP/1.1 Sep 25 04:41:27.493862 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept: application/json Sep 25 04:41:27.493862 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept-Encoding: identity Sep 25 04:41:27.493862 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Connection: close Sep 25 04:41:27.493862 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Length: 0 Sep 25 04:41:27.493862 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Type: application/json Sep 25 04:41:27.493862 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Host: 10.222.0.25 Sep 25 04:41:27.493862 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Openstack-System-Scope: None Sep 25 04:41:27.493862 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: User-Agent: python-urllib3/1.26.12 Sep 25 04:41:27.493862 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Auth-Token: gAAAAABjL9sBvKJonII0md8Uel-VaQAgJDBD0k2kuAGfH9SCnoHBlY2k63vMVL4xwUfW55iWUBrdtJzrzAbfQzmKa4XNt1K1Q5cgwpxfRII9Uf-ABjlw9jXXQkm1L2JmCwhb2KBUCmKpdykzX8IeoJTJ0Wod09v7wxS1cwHQcTKHQpk-DExyzrs Sep 25 04:41:27.493862 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Id: None Sep 25 04:41:27.493862 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Name: None Sep 25 04:41:27.493862 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Identity-Status: Confirmed Sep 25 04:41:27.493862 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Is-Admin-Project: True Sep 25 04:41:27.493862 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Id: default Sep 25 04:41:27.493862 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Name: Default Sep 25 04:41:27.493862 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Id: 00f66d2c942b419abc8d9d010c5a57f3 Sep 25 04:41:27.493862 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Name: tempest-TestVolumeBootPattern-174108509 Sep 25 04:41:27.493862 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Role: reader,member Sep 25 04:41:27.493862 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Roles: reader,member Sep 25 04:41:27.495562 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/00f66d2c942b419abc8d9d010c5a57f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00f66d2c942b419abc8d9d010c5a57f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00f66d2c942b419abc8d9d010c5a57f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_00f66d2c942b419abc8d9d010c5a57f3"}]}] Sep 25 04:41:27.495562 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant: tempest-TestVolumeBootPattern-174108509 Sep 25 04:41:27.495562 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Id: 00f66d2c942b419abc8d9d010c5a57f3 Sep 25 04:41:27.495562 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Name: tempest-TestVolumeBootPattern-174108509 Sep 25 04:41:27.495562 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User: tempest-TestVolumeBootPattern-174108509-project Sep 25 04:41:27.495562 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Id: default Sep 25 04:41:27.495562 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Name: Default Sep 25 04:41:27.495562 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Id: 329e3f9810b648218dd45a8b489adb1d Sep 25 04:41:27.495562 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Name: tempest-TestVolumeBootPattern-174108509-project Sep 25 04:41:27.495562 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: method: > Sep 25 04:41:27.495562 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: exception: Instance d6138f3e-a927-4d61-890c-ccd60213e4f2 could not be found. Sep 25 04:41:27.495562 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: action_args: {'id': 'd6138f3e-a927-4d61-890c-ccd60213e4f2'} Sep 25 04:41:27.496383 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:41:27.496383 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:41:27.496383 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:41:27.496383 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:41:27.496383 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:41:27.496383 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:41:27.496383 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:41:27.496383 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:41:27.496383 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:41:27.496383 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:41:27.496383 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6138f3e-a927-4d61-890c-ccd60213e4f2 could not be found. Sep 25 04:41:27.496383 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:41:27.496383 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:41:27.496383 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:41:27.496383 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:41:27.496383 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:41:27.496383 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:41:27.496383 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:41:27.496383 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:41:27.496383 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:41:27.497817 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:41:27.497817 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 04:41:27.497817 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 04:41:27.497817 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:41:27.497817 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:41:27.497817 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:41:27.497817 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:41:27.497817 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6138f3e-a927-4d61-890c-ccd60213e4f2 could not be found. Sep 25 04:41:27.497817 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:41:27.497817 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:41:27.497817 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:41:27.497817 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:41:27.497817 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:41:27.497817 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:41:27.497817 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:41:27.497817 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:41:27.497817 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6138f3e-a927-4d61-890c-ccd60213e4f2 could not be found. Sep 25 04:41:27.497817 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:41:27.498934 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-c8b1da2d-4ee7-410f-a3a6-9ff85c170a65 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Returning 404 to user: Instance d6138f3e-a927-4d61-890c-ccd60213e4f2 could not be found. {{(pid=127142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:41:27.498934 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-c8b1da2d-4ee7-410f-a3a6-9ff85c170a65 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2" status: 404 len: 111 microversion: 2.1 time: 0.035544 Sep 25 04:41:27.498934 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 347/640] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:27 2022] GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 04:41:27.555629 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-ab0edf82-83a6-4459-83d1-201ccbcae2d1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:27.556257 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-ab0edf82-83a6-4459-83d1-201ccbcae2d1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:27.562914 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ab0edf82-83a6-4459-83d1-201ccbcae2d1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:27.563406 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ab0edf82-83a6-4459-83d1-201ccbcae2d1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:27.563836 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ab0edf82-83a6-4459-83d1-201ccbcae2d1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:27.564533 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ab0edf82-83a6-4459-83d1-201ccbcae2d1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:27.565101 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ab0edf82-83a6-4459-83d1-201ccbcae2d1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:27.565529 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ab0edf82-83a6-4459-83d1-201ccbcae2d1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:27.603888 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-71f40c55-9f4e-4669-a655-09eb9fd5ba27 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-725505392", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-363590622", "security_groups": [{"name": "tempest-secgroup-smoke-2021890742"}], "block_device_mapping_v2": [{"uuid": "20cb2454-9baf-43cb-929e-c8123bf94ff6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fc0edd4f-78eb-4338-9c41-437457efbef1"}]}} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:41:27.761935 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.network.neutron [None req-71f40c55-9f4e-4669-a655-09eb9fd5ba27 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] validate_networks() for [('fc0edd4f-78eb-4338-9c41-437457efbef1', None, None, None, None, None)] {{(pid=127142) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 04:41:27.766163 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-ab0edf82-83a6-4459-83d1-201ccbcae2d1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:27.774647 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-ab0edf82-83a6-4459-83d1-201ccbcae2d1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1680 microversion: 2.1 time: 0.222893 Sep 25 04:41:27.775218 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 294/641] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:27 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1680 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:28.175712 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-71f40c55-9f4e-4669-a655-09eb9fd5ba27 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Flavor limits 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 04:41:28.176224 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-71f40c55-9f4e-4669-a655-09eb9fd5ba27 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Image limits 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 04:41:28.176748 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-71f40c55-9f4e-4669-a655-09eb9fd5ba27 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Flavor pref 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 04:41:28.177168 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-71f40c55-9f4e-4669-a655-09eb9fd5ba27 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Image pref 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 04:41:28.177585 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-71f40c55-9f4e-4669-a655-09eb9fd5ba27 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 04:41:28.186626 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-71f40c55-9f4e-4669-a655-09eb9fd5ba27 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:28.187113 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-71f40c55-9f4e-4669-a655-09eb9fd5ba27 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:28.187551 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-71f40c55-9f4e-4669-a655-09eb9fd5ba27 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:28.188285 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-71f40c55-9f4e-4669-a655-09eb9fd5ba27 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:28.188783 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-71f40c55-9f4e-4669-a655-09eb9fd5ba27 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:28.189210 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-71f40c55-9f4e-4669-a655-09eb9fd5ba27 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:28.206236 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.quota [None req-71f40c55-9f4e-4669-a655-09eb9fd5ba27 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Getting quotas for project 00f66d2c942b419abc8d9d010c5a57f3. Resources: {'instances', 'ram', 'cores'} {{(pid=127142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 04:41:28.210669 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.quota [None req-71f40c55-9f4e-4669-a655-09eb9fd5ba27 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Getting quotas for user 329e3f9810b648218dd45a8b489adb1d and project 00f66d2c942b419abc8d9d010c5a57f3. Resources: {'instances', 'ram', 'cores'} {{(pid=127142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 04:41:28.267903 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-71f40c55-9f4e-4669-a655-09eb9fd5ba27 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Going to run 1 instances... {{(pid=127142) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 04:41:28.270702 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-71f40c55-9f4e-4669-a655-09eb9fd5ba27 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: a88affa4-277d-4c8f-b8ab-5b9fca9e12ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='20cb2454-9baf-43cb-929e-c8123bf94ff6',volume_size=None,volume_type=None)] {{(pid=127142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 04:41:28.397574 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-71f40c55-9f4e-4669-a655-09eb9fd5ba27 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.798760 Sep 25 04:41:28.398311 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 348/642] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 25 04:41:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 04:41:28.409608 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-f67bcb84-d850-48c5-9919-561d70c35d41 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:28.410583 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-f67bcb84-d850-48c5-9919-561d70c35d41 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: a88affa4-277d-4c8f-b8ab-5b9fca9e12ec] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:28.466935 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-f67bcb84-d850-48c5-9919-561d70c35d41 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:28.474793 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-f67bcb84-d850-48c5-9919-561d70c35d41 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec" status: 200 len: 1093 microversion: 2.1 time: 0.069006 Sep 25 04:41:28.475593 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 295/643] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:28 2022] GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:28.797708 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-a044a645-68f2-4ad4-84b9-78e40884d99b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:28.798325 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-a044a645-68f2-4ad4-84b9-78e40884d99b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:28.805698 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a044a645-68f2-4ad4-84b9-78e40884d99b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:28.806201 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a044a645-68f2-4ad4-84b9-78e40884d99b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:28.806683 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a044a645-68f2-4ad4-84b9-78e40884d99b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:28.807371 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a044a645-68f2-4ad4-84b9-78e40884d99b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:28.807832 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a044a645-68f2-4ad4-84b9-78e40884d99b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:28.808257 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a044a645-68f2-4ad4-84b9-78e40884d99b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:28.956966 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-a044a645-68f2-4ad4-84b9-78e40884d99b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:28.966006 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-a044a645-68f2-4ad4-84b9-78e40884d99b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1680 microversion: 2.1 time: 0.172160 Sep 25 04:41:28.966808 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 349/644] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:28 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:28.998191 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-142de359-ec03-4a71-9f30-15c590f173f9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:41:29.000671 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-142de359-ec03-4a71-9f30-15c590f173f9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:29.008803 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-142de359-ec03-4a71-9f30-15c590f173f9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:29.009446 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-142de359-ec03-4a71-9f30-15c590f173f9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:29.009930 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-142de359-ec03-4a71-9f30-15c590f173f9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:29.010587 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-142de359-ec03-4a71-9f30-15c590f173f9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:29.011037 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-142de359-ec03-4a71-9f30-15c590f173f9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:29.011510 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-142de359-ec03-4a71-9f30-15c590f173f9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:29.083195 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-142de359-ec03-4a71-9f30-15c590f173f9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "POST /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65/action" status: 202 len: 0 microversion: 2.1 time: 0.088640 Sep 25 04:41:29.083822 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 296/645] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 25 04:41:28 2022] POST /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 04:41:29.092246 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-8b009e5d-4228-4853-9842-0db9d39bfe7a tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:29.092901 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-8b009e5d-4228-4853-9842-0db9d39bfe7a tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:29.098939 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8b009e5d-4228-4853-9842-0db9d39bfe7a tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:29.099424 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8b009e5d-4228-4853-9842-0db9d39bfe7a tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:29.099860 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8b009e5d-4228-4853-9842-0db9d39bfe7a tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:29.100583 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8b009e5d-4228-4853-9842-0db9d39bfe7a tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:29.101080 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8b009e5d-4228-4853-9842-0db9d39bfe7a tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:29.101524 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8b009e5d-4228-4853-9842-0db9d39bfe7a tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:29.244336 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-8b009e5d-4228-4853-9842-0db9d39bfe7a tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:29.254347 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-8b009e5d-4228-4853-9842-0db9d39bfe7a tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1752 microversion: 2.1 time: 0.165329 Sep 25 04:41:29.255280 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 350/646] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:29 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:29.498307 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-6d06266b-e6b9-42f6-8d5e-65db0b89a6c0 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:29.499016 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-6d06266b-e6b9-42f6-8d5e-65db0b89a6c0 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: a88affa4-277d-4c8f-b8ab-5b9fca9e12ec] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:29.505787 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6d06266b-e6b9-42f6-8d5e-65db0b89a6c0 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:29.506423 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6d06266b-e6b9-42f6-8d5e-65db0b89a6c0 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:29.506869 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6d06266b-e6b9-42f6-8d5e-65db0b89a6c0 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:29.507569 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6d06266b-e6b9-42f6-8d5e-65db0b89a6c0 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:29.508025 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6d06266b-e6b9-42f6-8d5e-65db0b89a6c0 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:29.508449 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6d06266b-e6b9-42f6-8d5e-65db0b89a6c0 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:29.594636 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-6d06266b-e6b9-42f6-8d5e-65db0b89a6c0 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:29.604375 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-6d06266b-e6b9-42f6-8d5e-65db0b89a6c0 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec" status: 200 len: 1191 microversion: 2.1 time: 0.110286 Sep 25 04:41:29.605025 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 297/647] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:29 2022] GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec => generated 1191 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:29.988951 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-8306c6bb-1f8b-4106-abd8-5f547a2c7336 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:29.989566 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-8306c6bb-1f8b-4106-abd8-5f547a2c7336 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:29.996141 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8306c6bb-1f8b-4106-abd8-5f547a2c7336 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:29.996921 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8306c6bb-1f8b-4106-abd8-5f547a2c7336 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:29.997527 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8306c6bb-1f8b-4106-abd8-5f547a2c7336 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:29.998221 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8306c6bb-1f8b-4106-abd8-5f547a2c7336 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:29.998678 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8306c6bb-1f8b-4106-abd8-5f547a2c7336 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:29.999104 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8306c6bb-1f8b-4106-abd8-5f547a2c7336 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:30.253934 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-8306c6bb-1f8b-4106-abd8-5f547a2c7336 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:30.262147 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-8306c6bb-1f8b-4106-abd8-5f547a2c7336 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1680 microversion: 2.1 time: 0.277125 Sep 25 04:41:30.276365 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 351/648] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:29 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1680 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:30.279425 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-cb31d25f-fbd8-48e2-9f86-80a246a47362 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:30.280035 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-cb31d25f-fbd8-48e2-9f86-80a246a47362 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:30.287540 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cb31d25f-fbd8-48e2-9f86-80a246a47362 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:30.288073 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cb31d25f-fbd8-48e2-9f86-80a246a47362 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:30.288517 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cb31d25f-fbd8-48e2-9f86-80a246a47362 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:30.289268 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cb31d25f-fbd8-48e2-9f86-80a246a47362 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:30.289725 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cb31d25f-fbd8-48e2-9f86-80a246a47362 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:30.290212 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cb31d25f-fbd8-48e2-9f86-80a246a47362 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:30.526240 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-cb31d25f-fbd8-48e2-9f86-80a246a47362 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:30.534733 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-cb31d25f-fbd8-48e2-9f86-80a246a47362 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1752 microversion: 2.1 time: 0.259172 Sep 25 04:41:30.535730 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 298/649] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:30 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1752 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:30.627587 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-eb182f4f-2530-42bb-839e-e0e01db9eeed tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:30.629316 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-eb182f4f-2530-42bb-839e-e0e01db9eeed tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: a88affa4-277d-4c8f-b8ab-5b9fca9e12ec] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:30.635457 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-eb182f4f-2530-42bb-839e-e0e01db9eeed tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:30.635941 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-eb182f4f-2530-42bb-839e-e0e01db9eeed tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:30.636371 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-eb182f4f-2530-42bb-839e-e0e01db9eeed tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:30.637074 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-eb182f4f-2530-42bb-839e-e0e01db9eeed tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:30.637526 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-eb182f4f-2530-42bb-839e-e0e01db9eeed tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:30.637946 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-eb182f4f-2530-42bb-839e-e0e01db9eeed tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:30.703246 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-eb182f4f-2530-42bb-839e-e0e01db9eeed tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:30.711677 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-eb182f4f-2530-42bb-839e-e0e01db9eeed tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec" status: 200 len: 1209 microversion: 2.1 time: 0.087951 Sep 25 04:41:30.712236 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 352/650] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:30 2022] GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec => generated 1209 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:31.286808 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-66129d0d-b4c2-498e-90fb-eb1d3831cd29 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:31.287395 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-66129d0d-b4c2-498e-90fb-eb1d3831cd29 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:31.294753 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-66129d0d-b4c2-498e-90fb-eb1d3831cd29 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:31.295242 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-66129d0d-b4c2-498e-90fb-eb1d3831cd29 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:31.295675 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-66129d0d-b4c2-498e-90fb-eb1d3831cd29 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:31.296367 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-66129d0d-b4c2-498e-90fb-eb1d3831cd29 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:31.296853 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-66129d0d-b4c2-498e-90fb-eb1d3831cd29 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:31.297280 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-66129d0d-b4c2-498e-90fb-eb1d3831cd29 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:31.520816 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-66129d0d-b4c2-498e-90fb-eb1d3831cd29 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:31.528680 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-66129d0d-b4c2-498e-90fb-eb1d3831cd29 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1680 microversion: 2.1 time: 0.246067 Sep 25 04:41:31.529255 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 299/651] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:31 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1680 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:31.558018 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-47b8dd92-7850-48ea-9aaf-0ccd6405a526 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:31.558632 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-47b8dd92-7850-48ea-9aaf-0ccd6405a526 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:31.565178 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-47b8dd92-7850-48ea-9aaf-0ccd6405a526 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:31.566155 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-47b8dd92-7850-48ea-9aaf-0ccd6405a526 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:31.566601 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-47b8dd92-7850-48ea-9aaf-0ccd6405a526 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:31.567291 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-47b8dd92-7850-48ea-9aaf-0ccd6405a526 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:31.567738 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-47b8dd92-7850-48ea-9aaf-0ccd6405a526 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:31.568163 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-47b8dd92-7850-48ea-9aaf-0ccd6405a526 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:31.735427 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-eec97984-60eb-41bb-b4dc-2742b3ce2a89 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:31.736215 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-eec97984-60eb-41bb-b4dc-2742b3ce2a89 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: a88affa4-277d-4c8f-b8ab-5b9fca9e12ec] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:31.743762 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-eec97984-60eb-41bb-b4dc-2742b3ce2a89 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:31.744337 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-eec97984-60eb-41bb-b4dc-2742b3ce2a89 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:31.744879 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-eec97984-60eb-41bb-b4dc-2742b3ce2a89 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:31.745702 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-eec97984-60eb-41bb-b4dc-2742b3ce2a89 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:31.746228 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-eec97984-60eb-41bb-b4dc-2742b3ce2a89 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:31.746730 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-eec97984-60eb-41bb-b4dc-2742b3ce2a89 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:31.771646 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-47b8dd92-7850-48ea-9aaf-0ccd6405a526 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:31.783319 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-47b8dd92-7850-48ea-9aaf-0ccd6405a526 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1757 microversion: 2.1 time: 0.229099 Sep 25 04:41:31.784544 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 353/652] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:31 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1757 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:31.923881 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-f6804d4b-0bb4-4054-9940-4f3377f97046 req-f0e7cea4-8fc2-45c9-a59a-747f61f9aac1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a88affa4-277d-4c8f-b8ab-5b9fca9e12ec", "tag": "d940c3fc-ea28-4472-a65e-66e192fca8c0"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:41:31.945566 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-f6804d4b-0bb4-4054-9940-4f3377f97046 req-f0e7cea4-8fc2-45c9-a59a-747f61f9aac1 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:31.946381 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-f6804d4b-0bb4-4054-9940-4f3377f97046 req-f0e7cea4-8fc2-45c9-a59a-747f61f9aac1 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:31.946900 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-f6804d4b-0bb4-4054-9940-4f3377f97046 req-f0e7cea4-8fc2-45c9-a59a-747f61f9aac1 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:31.966521 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-eec97984-60eb-41bb-b4dc-2742b3ce2a89 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:31.967776 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-f6804d4b-0bb4-4054-9940-4f3377f97046 req-f0e7cea4-8fc2-45c9-a59a-747f61f9aac1 service nova] Creating event network-changed:d940c3fc-ea28-4472-a65e-66e192fca8c0 for instance a88affa4-277d-4c8f-b8ab-5b9fca9e12ec on hv-cinder-85535 Sep 25 04:41:31.973677 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-f6804d4b-0bb4-4054-9940-4f3377f97046 req-f0e7cea4-8fc2-45c9-a59a-747f61f9aac1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055668 Sep 25 04:41:31.974664 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 354/653] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:41:31.975451 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-eec97984-60eb-41bb-b4dc-2742b3ce2a89 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec" status: 200 len: 1265 microversion: 2.1 time: 0.243874 Sep 25 04:41:31.976029 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 300/654] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:31 2022] GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec => generated 1265 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:41:32.553633 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-262cb56d-0c4f-453e-b56e-e25429c8b6e8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:32.554327 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-262cb56d-0c4f-453e-b56e-e25429c8b6e8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:32.560541 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-262cb56d-0c4f-453e-b56e-e25429c8b6e8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:32.561134 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-262cb56d-0c4f-453e-b56e-e25429c8b6e8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:32.561481 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-262cb56d-0c4f-453e-b56e-e25429c8b6e8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:32.562160 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-262cb56d-0c4f-453e-b56e-e25429c8b6e8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:32.562620 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-262cb56d-0c4f-453e-b56e-e25429c8b6e8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:32.563046 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-262cb56d-0c4f-453e-b56e-e25429c8b6e8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:32.807513 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-9067803b-01eb-40ad-a323-f8ab3e27cfd1 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:32.808156 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-9067803b-01eb-40ad-a323-f8ab3e27cfd1 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:32.815084 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9067803b-01eb-40ad-a323-f8ab3e27cfd1 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:32.815581 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9067803b-01eb-40ad-a323-f8ab3e27cfd1 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:32.816610 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9067803b-01eb-40ad-a323-f8ab3e27cfd1 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:32.817349 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9067803b-01eb-40ad-a323-f8ab3e27cfd1 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:32.817795 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9067803b-01eb-40ad-a323-f8ab3e27cfd1 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:32.818224 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9067803b-01eb-40ad-a323-f8ab3e27cfd1 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:32.963712 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-262cb56d-0c4f-453e-b56e-e25429c8b6e8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:32.971490 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-262cb56d-0c4f-453e-b56e-e25429c8b6e8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1680 microversion: 2.1 time: 0.422602 Sep 25 04:41:32.972123 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 355/655] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:32 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1680 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:41:32.999231 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-b2de9945-213f-41f5-9319-0710517cb5c2 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:32.999929 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-b2de9945-213f-41f5-9319-0710517cb5c2 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: a88affa4-277d-4c8f-b8ab-5b9fca9e12ec] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:33.001938 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:41:33.008438 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b2de9945-213f-41f5-9319-0710517cb5c2 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:33.009034 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b2de9945-213f-41f5-9319-0710517cb5c2 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:33.009472 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b2de9945-213f-41f5-9319-0710517cb5c2 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:33.010172 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b2de9945-213f-41f5-9319-0710517cb5c2 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:33.010630 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b2de9945-213f-41f5-9319-0710517cb5c2 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:33.011055 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b2de9945-213f-41f5-9319-0710517cb5c2 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:33.021154 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-9067803b-01eb-40ad-a323-f8ab3e27cfd1 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:33.029465 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-9067803b-01eb-40ad-a323-f8ab3e27cfd1 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1757 microversion: 2.1 time: 0.225845 Sep 25 04:41:33.030397 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 301/656] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:32 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1757 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:41:33.147377 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-b2de9945-213f-41f5-9319-0710517cb5c2 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:33.154915 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-b2de9945-213f-41f5-9319-0710517cb5c2 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec" status: 200 len: 1265 microversion: 2.1 time: 0.159566 Sep 25 04:41:33.155476 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 356/657] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:32 2022] GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:33.995319 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-7da03bd1-910e-4544-a101-7040eaa1d289 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:33.995956 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-7da03bd1-910e-4544-a101-7040eaa1d289 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:34.002971 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7da03bd1-910e-4544-a101-7040eaa1d289 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:34.004301 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7da03bd1-910e-4544-a101-7040eaa1d289 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:34.004882 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7da03bd1-910e-4544-a101-7040eaa1d289 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:34.005575 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7da03bd1-910e-4544-a101-7040eaa1d289 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:34.006029 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7da03bd1-910e-4544-a101-7040eaa1d289 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:34.006453 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7da03bd1-910e-4544-a101-7040eaa1d289 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:34.053823 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-8842a11a-f712-4580-ae38-0d1dec9384d5 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:34.054331 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-8842a11a-f712-4580-ae38-0d1dec9384d5 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:34.062040 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8842a11a-f712-4580-ae38-0d1dec9384d5 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:34.062659 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8842a11a-f712-4580-ae38-0d1dec9384d5 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:34.063173 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8842a11a-f712-4580-ae38-0d1dec9384d5 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:34.063982 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8842a11a-f712-4580-ae38-0d1dec9384d5 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:34.064447 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8842a11a-f712-4580-ae38-0d1dec9384d5 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:34.064925 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8842a11a-f712-4580-ae38-0d1dec9384d5 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:34.287027 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-7da03bd1-910e-4544-a101-7040eaa1d289 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:34.294852 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-7da03bd1-910e-4544-a101-7040eaa1d289 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1680 microversion: 2.1 time: 0.303504 Sep 25 04:41:34.295423 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 302/658] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:33 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1680 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:34.299878 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-4a0dc43f-e448-44ef-b25d-2a7c30dc1bad tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:34.301197 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-4a0dc43f-e448-44ef-b25d-2a7c30dc1bad tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: a88affa4-277d-4c8f-b8ab-5b9fca9e12ec] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:34.307321 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4a0dc43f-e448-44ef-b25d-2a7c30dc1bad tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:34.307756 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4a0dc43f-e448-44ef-b25d-2a7c30dc1bad tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:34.308195 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4a0dc43f-e448-44ef-b25d-2a7c30dc1bad tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:34.308919 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4a0dc43f-e448-44ef-b25d-2a7c30dc1bad tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:34.309380 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4a0dc43f-e448-44ef-b25d-2a7c30dc1bad tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:34.309813 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4a0dc43f-e448-44ef-b25d-2a7c30dc1bad tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:34.359298 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-8842a11a-f712-4580-ae38-0d1dec9384d5 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:34.369762 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-8842a11a-f712-4580-ae38-0d1dec9384d5 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1757 microversion: 2.1 time: 0.320746 Sep 25 04:41:34.370354 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 357/659] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:34 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1757 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:41:34.487131 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-4a0dc43f-e448-44ef-b25d-2a7c30dc1bad tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:34.495977 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-4a0dc43f-e448-44ef-b25d-2a7c30dc1bad tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec" status: 200 len: 1265 microversion: 2.1 time: 0.199582 Sep 25 04:41:34.496537 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 303/660] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:34 2022] GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:35.319425 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-d22b3b9b-81ab-4c07-813f-58b5098684a0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:35.320071 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-d22b3b9b-81ab-4c07-813f-58b5098684a0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:35.330805 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d22b3b9b-81ab-4c07-813f-58b5098684a0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:35.332359 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d22b3b9b-81ab-4c07-813f-58b5098684a0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:35.333217 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d22b3b9b-81ab-4c07-813f-58b5098684a0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:35.334181 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d22b3b9b-81ab-4c07-813f-58b5098684a0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:35.334909 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d22b3b9b-81ab-4c07-813f-58b5098684a0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:35.335348 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d22b3b9b-81ab-4c07-813f-58b5098684a0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:35.393562 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-321c7c07-a125-4267-adde-71249abdcc1d tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:35.394358 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-321c7c07-a125-4267-adde-71249abdcc1d tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:35.396828 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:41:35.401930 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-321c7c07-a125-4267-adde-71249abdcc1d tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:35.402610 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-321c7c07-a125-4267-adde-71249abdcc1d tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:35.403071 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-321c7c07-a125-4267-adde-71249abdcc1d tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:35.403795 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-321c7c07-a125-4267-adde-71249abdcc1d tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:35.404247 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-321c7c07-a125-4267-adde-71249abdcc1d tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:35.404777 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-321c7c07-a125-4267-adde-71249abdcc1d tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:35.497039 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-d22b3b9b-81ab-4c07-813f-58b5098684a0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:35.505421 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-d22b3b9b-81ab-4c07-813f-58b5098684a0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1680 microversion: 2.1 time: 0.190259 Sep 25 04:41:35.505860 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 358/661] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:35 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1680 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:35.523748 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-81ea6221-e974-4a3e-8a4d-f55863367933 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:35.524406 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-81ea6221-e974-4a3e-8a4d-f55863367933 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: a88affa4-277d-4c8f-b8ab-5b9fca9e12ec] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:35.530331 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-81ea6221-e974-4a3e-8a4d-f55863367933 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:35.530823 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-81ea6221-e974-4a3e-8a4d-f55863367933 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:35.531268 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-81ea6221-e974-4a3e-8a4d-f55863367933 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:35.531963 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-81ea6221-e974-4a3e-8a4d-f55863367933 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:35.532418 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-81ea6221-e974-4a3e-8a4d-f55863367933 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:35.532888 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-81ea6221-e974-4a3e-8a4d-f55863367933 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:35.570290 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-321c7c07-a125-4267-adde-71249abdcc1d tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:35.578396 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-321c7c07-a125-4267-adde-71249abdcc1d tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1757 microversion: 2.1 time: 0.188739 Sep 25 04:41:35.578976 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 304/662] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:35 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1757 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:41:35.665130 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-81ea6221-e974-4a3e-8a4d-f55863367933 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:35.672791 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-81ea6221-e974-4a3e-8a4d-f55863367933 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec" status: 200 len: 1265 microversion: 2.1 time: 0.152788 Sep 25 04:41:35.673358 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 359/663] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:35 2022] GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:41:36.529118 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-1156ea03-ca31-406d-9764-8ab9367744db tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:36.529736 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-1156ea03-ca31-406d-9764-8ab9367744db tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:36.536976 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1156ea03-ca31-406d-9764-8ab9367744db tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:36.537468 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1156ea03-ca31-406d-9764-8ab9367744db tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:36.537907 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1156ea03-ca31-406d-9764-8ab9367744db tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:36.538601 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1156ea03-ca31-406d-9764-8ab9367744db tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:36.539063 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1156ea03-ca31-406d-9764-8ab9367744db tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:36.539491 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1156ea03-ca31-406d-9764-8ab9367744db tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:36.602157 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-6afe55dd-8854-4a31-bf08-e8a2e4f22370 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:36.602795 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-6afe55dd-8854-4a31-bf08-e8a2e4f22370 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:36.609180 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6afe55dd-8854-4a31-bf08-e8a2e4f22370 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:36.609665 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6afe55dd-8854-4a31-bf08-e8a2e4f22370 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:36.610101 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6afe55dd-8854-4a31-bf08-e8a2e4f22370 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:36.610793 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6afe55dd-8854-4a31-bf08-e8a2e4f22370 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:36.611246 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6afe55dd-8854-4a31-bf08-e8a2e4f22370 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:36.611668 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6afe55dd-8854-4a31-bf08-e8a2e4f22370 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:36.699081 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-1156ea03-ca31-406d-9764-8ab9367744db tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:36.706940 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-1156ea03-ca31-406d-9764-8ab9367744db tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1680 microversion: 2.1 time: 0.181703 Sep 25 04:41:36.707523 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 305/664] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:36 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1680 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:36.712247 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-18fe8dac-98de-4ab0-955f-17a51c816dd3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:36.712885 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-18fe8dac-98de-4ab0-955f-17a51c816dd3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: a88affa4-277d-4c8f-b8ab-5b9fca9e12ec] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:36.718742 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-18fe8dac-98de-4ab0-955f-17a51c816dd3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:36.719235 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-18fe8dac-98de-4ab0-955f-17a51c816dd3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:36.719729 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-18fe8dac-98de-4ab0-955f-17a51c816dd3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:36.720620 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-18fe8dac-98de-4ab0-955f-17a51c816dd3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:36.721446 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-18fe8dac-98de-4ab0-955f-17a51c816dd3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:36.721559 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-18fe8dac-98de-4ab0-955f-17a51c816dd3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:36.802527 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-6afe55dd-8854-4a31-bf08-e8a2e4f22370 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:36.811018 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-6afe55dd-8854-4a31-bf08-e8a2e4f22370 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1757 microversion: 2.1 time: 0.212725 Sep 25 04:41:36.811591 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 360/665] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:36 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1757 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:41:36.873135 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-18fe8dac-98de-4ab0-955f-17a51c816dd3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:36.880683 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-18fe8dac-98de-4ab0-955f-17a51c816dd3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec" status: 200 len: 1265 microversion: 2.1 time: 0.172193 Sep 25 04:41:36.881273 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 306/666] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:36 2022] GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:37.731177 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-4fdbbef3-c354-4e79-b656-8e47a2fddfb0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:37.731836 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-4fdbbef3-c354-4e79-b656-8e47a2fddfb0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:37.738906 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4fdbbef3-c354-4e79-b656-8e47a2fddfb0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:37.739386 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4fdbbef3-c354-4e79-b656-8e47a2fddfb0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:37.739828 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4fdbbef3-c354-4e79-b656-8e47a2fddfb0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:37.740512 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4fdbbef3-c354-4e79-b656-8e47a2fddfb0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:37.740993 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4fdbbef3-c354-4e79-b656-8e47a2fddfb0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:37.741418 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4fdbbef3-c354-4e79-b656-8e47a2fddfb0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:37.834338 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-81d349b1-5145-4419-aa85-935f36003a91 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:37.835632 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-81d349b1-5145-4419-aa85-935f36003a91 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:37.842614 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-81d349b1-5145-4419-aa85-935f36003a91 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:37.843108 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-81d349b1-5145-4419-aa85-935f36003a91 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:37.843545 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-81d349b1-5145-4419-aa85-935f36003a91 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:37.844244 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-81d349b1-5145-4419-aa85-935f36003a91 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:37.844725 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-81d349b1-5145-4419-aa85-935f36003a91 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:37.845152 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-81d349b1-5145-4419-aa85-935f36003a91 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:37.876409 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-4fdbbef3-c354-4e79-b656-8e47a2fddfb0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:37.885420 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-4fdbbef3-c354-4e79-b656-8e47a2fddfb0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1680 microversion: 2.1 time: 0.158110 Sep 25 04:41:37.886002 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 361/667] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:37 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:37.905269 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-bd3ea0e2-a33e-431d-8e59-53bce6d76260 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:37.905894 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-bd3ea0e2-a33e-431d-8e59-53bce6d76260 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: a88affa4-277d-4c8f-b8ab-5b9fca9e12ec] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:37.912182 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bd3ea0e2-a33e-431d-8e59-53bce6d76260 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:37.912711 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bd3ea0e2-a33e-431d-8e59-53bce6d76260 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:37.913152 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bd3ea0e2-a33e-431d-8e59-53bce6d76260 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:37.913840 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bd3ea0e2-a33e-431d-8e59-53bce6d76260 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:37.914291 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bd3ea0e2-a33e-431d-8e59-53bce6d76260 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:37.914710 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bd3ea0e2-a33e-431d-8e59-53bce6d76260 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:38.026708 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-81d349b1-5145-4419-aa85-935f36003a91 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:38.035371 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-81d349b1-5145-4419-aa85-935f36003a91 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1757 microversion: 2.1 time: 0.204843 Sep 25 04:41:38.036214 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 307/668] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:37 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1757 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:41:38.085393 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-bd3ea0e2-a33e-431d-8e59-53bce6d76260 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:38.093930 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-bd3ea0e2-a33e-431d-8e59-53bce6d76260 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec" status: 200 len: 1265 microversion: 2.1 time: 0.194483 Sep 25 04:41:38.094485 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 362/669] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:37 2022] GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:41:38.908647 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-418a0340-68d2-4a1e-9ef3-68ad70670f54 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:38.909305 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-418a0340-68d2-4a1e-9ef3-68ad70670f54 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:38.911506 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell0:SELECT=2 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:41:38.917278 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-418a0340-68d2-4a1e-9ef3-68ad70670f54 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:38.917788 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-418a0340-68d2-4a1e-9ef3-68ad70670f54 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:38.918254 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-418a0340-68d2-4a1e-9ef3-68ad70670f54 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:38.918971 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-418a0340-68d2-4a1e-9ef3-68ad70670f54 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:38.919418 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-418a0340-68d2-4a1e-9ef3-68ad70670f54 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:38.919872 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-418a0340-68d2-4a1e-9ef3-68ad70670f54 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:39.050568 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-418a0340-68d2-4a1e-9ef3-68ad70670f54 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:39.058710 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-418a0340-68d2-4a1e-9ef3-68ad70670f54 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1680 microversion: 2.1 time: 0.153903 Sep 25 04:41:39.059137 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-244eefc7-637f-48ab-9684-0aa74b88b29d tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:39.059587 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 308/670] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:38 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:39.059749 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-244eefc7-637f-48ab-9684-0aa74b88b29d tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:39.061607 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell0:SELECT=2 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:41:39.062401 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell0:SELECT=6 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:41:39.070230 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-244eefc7-637f-48ab-9684-0aa74b88b29d tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:39.070994 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-244eefc7-637f-48ab-9684-0aa74b88b29d tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:39.071622 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-244eefc7-637f-48ab-9684-0aa74b88b29d tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:39.072759 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-244eefc7-637f-48ab-9684-0aa74b88b29d tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:39.073456 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-244eefc7-637f-48ab-9684-0aa74b88b29d tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:39.074147 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-244eefc7-637f-48ab-9684-0aa74b88b29d tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:39.118516 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-2e32d8da-fe3b-4e37-bbb3-f0b61bf796a6 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:39.119151 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-2e32d8da-fe3b-4e37-bbb3-f0b61bf796a6 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: a88affa4-277d-4c8f-b8ab-5b9fca9e12ec] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:39.125149 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2e32d8da-fe3b-4e37-bbb3-f0b61bf796a6 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:39.125639 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2e32d8da-fe3b-4e37-bbb3-f0b61bf796a6 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:39.126111 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2e32d8da-fe3b-4e37-bbb3-f0b61bf796a6 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:39.126801 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2e32d8da-fe3b-4e37-bbb3-f0b61bf796a6 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:39.127252 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2e32d8da-fe3b-4e37-bbb3-f0b61bf796a6 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:39.127674 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2e32d8da-fe3b-4e37-bbb3-f0b61bf796a6 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:39.279030 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-244eefc7-637f-48ab-9684-0aa74b88b29d tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:39.287725 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-244eefc7-637f-48ab-9684-0aa74b88b29d tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1757 microversion: 2.1 time: 0.232294 Sep 25 04:41:39.288402 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 363/671] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:39 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1757 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:41:39.310582 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-2e32d8da-fe3b-4e37-bbb3-f0b61bf796a6 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:39.318951 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-2e32d8da-fe3b-4e37-bbb3-f0b61bf796a6 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec" status: 200 len: 1265 microversion: 2.1 time: 0.205605 Sep 25 04:41:39.319589 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 309/672] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:39 2022] GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:41:40.083751 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-4727ec97-a483-4f64-ac6b-4fc8264c681b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:40.084357 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-4727ec97-a483-4f64-ac6b-4fc8264c681b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:40.091201 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4727ec97-a483-4f64-ac6b-4fc8264c681b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:40.091681 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4727ec97-a483-4f64-ac6b-4fc8264c681b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:40.092113 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4727ec97-a483-4f64-ac6b-4fc8264c681b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:40.092825 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4727ec97-a483-4f64-ac6b-4fc8264c681b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:40.093277 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4727ec97-a483-4f64-ac6b-4fc8264c681b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:40.093697 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4727ec97-a483-4f64-ac6b-4fc8264c681b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:40.228956 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-4727ec97-a483-4f64-ac6b-4fc8264c681b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:40.236665 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-4727ec97-a483-4f64-ac6b-4fc8264c681b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1680 microversion: 2.1 time: 0.157240 Sep 25 04:41:40.237226 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 364/673] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:40 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:40.311906 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-0fe9333d-b8b6-4c6d-8881-87fa0f8ef3a9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:40.312538 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-0fe9333d-b8b6-4c6d-8881-87fa0f8ef3a9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:40.319326 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0fe9333d-b8b6-4c6d-8881-87fa0f8ef3a9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:40.319820 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0fe9333d-b8b6-4c6d-8881-87fa0f8ef3a9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:40.320257 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0fe9333d-b8b6-4c6d-8881-87fa0f8ef3a9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:40.321539 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0fe9333d-b8b6-4c6d-8881-87fa0f8ef3a9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:40.321639 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0fe9333d-b8b6-4c6d-8881-87fa0f8ef3a9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:40.322013 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0fe9333d-b8b6-4c6d-8881-87fa0f8ef3a9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:40.324854 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:41:40.342481 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-55201092-b8b3-49c2-b6ac-125bfa2cb732 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:40.343124 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-55201092-b8b3-49c2-b6ac-125bfa2cb732 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: a88affa4-277d-4c8f-b8ab-5b9fca9e12ec] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:40.349990 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-55201092-b8b3-49c2-b6ac-125bfa2cb732 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:40.350521 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-55201092-b8b3-49c2-b6ac-125bfa2cb732 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:40.351025 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-55201092-b8b3-49c2-b6ac-125bfa2cb732 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:40.351778 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-55201092-b8b3-49c2-b6ac-125bfa2cb732 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:40.352243 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-55201092-b8b3-49c2-b6ac-125bfa2cb732 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:40.352766 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-55201092-b8b3-49c2-b6ac-125bfa2cb732 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:40.535478 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-0fe9333d-b8b6-4c6d-8881-87fa0f8ef3a9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:40.538812 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-55201092-b8b3-49c2-b6ac-125bfa2cb732 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:40.541047 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=100 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:41:40.543881 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-0fe9333d-b8b6-4c6d-8881-87fa0f8ef3a9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1757 microversion: 2.1 time: 0.235829 Sep 25 04:41:40.544507 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 310/674] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:40 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1757 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:40.547795 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-55201092-b8b3-49c2-b6ac-125bfa2cb732 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec" status: 200 len: 1265 microversion: 2.1 time: 0.209113 Sep 25 04:41:40.548360 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 365/675] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:40 2022] GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec => generated 1265 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:41:41.260237 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-bfc2fed5-1808-42fd-8ea0-0f59bdbfe55a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:41.260877 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-bfc2fed5-1808-42fd-8ea0-0f59bdbfe55a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:41.266819 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bfc2fed5-1808-42fd-8ea0-0f59bdbfe55a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:41.267310 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bfc2fed5-1808-42fd-8ea0-0f59bdbfe55a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:41.267753 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bfc2fed5-1808-42fd-8ea0-0f59bdbfe55a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:41.268451 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bfc2fed5-1808-42fd-8ea0-0f59bdbfe55a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:41.269024 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bfc2fed5-1808-42fd-8ea0-0f59bdbfe55a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:41.269604 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bfc2fed5-1808-42fd-8ea0-0f59bdbfe55a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:41.404605 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-bfc2fed5-1808-42fd-8ea0-0f59bdbfe55a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:41.413266 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-bfc2fed5-1808-42fd-8ea0-0f59bdbfe55a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1680 microversion: 2.1 time: 0.156868 Sep 25 04:41:41.413862 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 311/676] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:41 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:41.568311 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-ffe5afae-641f-4239-a14a-b3b5febec771 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:41.568951 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-ffe5afae-641f-4239-a14a-b3b5febec771 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:41.571301 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-88f71e05-1c81-4024-8cda-d99757531e70 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:41.571924 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-88f71e05-1c81-4024-8cda-d99757531e70 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: a88affa4-277d-4c8f-b8ab-5b9fca9e12ec] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:41.575410 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ffe5afae-641f-4239-a14a-b3b5febec771 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:41.575902 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ffe5afae-641f-4239-a14a-b3b5febec771 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:41.576341 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ffe5afae-641f-4239-a14a-b3b5febec771 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:41.577076 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ffe5afae-641f-4239-a14a-b3b5febec771 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:41.577515 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ffe5afae-641f-4239-a14a-b3b5febec771 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:41.577939 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ffe5afae-641f-4239-a14a-b3b5febec771 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:41.578038 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-88f71e05-1c81-4024-8cda-d99757531e70 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:41.578458 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-88f71e05-1c81-4024-8cda-d99757531e70 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:41.578901 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-88f71e05-1c81-4024-8cda-d99757531e70 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:41.579596 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-88f71e05-1c81-4024-8cda-d99757531e70 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:41.580059 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-88f71e05-1c81-4024-8cda-d99757531e70 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:41.580487 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-88f71e05-1c81-4024-8cda-d99757531e70 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:41.771059 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-88f71e05-1c81-4024-8cda-d99757531e70 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:41.778998 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-88f71e05-1c81-4024-8cda-d99757531e70 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec" status: 200 len: 1265 microversion: 2.1 time: 0.211444 Sep 25 04:41:41.779599 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 312/677] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:41 2022] GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:41:41.796436 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-ffe5afae-641f-4239-a14a-b3b5febec771 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:41.805035 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-ffe5afae-641f-4239-a14a-b3b5febec771 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1757 microversion: 2.1 time: 0.241006 Sep 25 04:41:41.805601 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 366/678] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:41 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1757 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:42.436547 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-e6b8a564-65f0-43b6-89a4-94e306435350 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:42.437199 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-e6b8a564-65f0-43b6-89a4-94e306435350 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:42.444192 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e6b8a564-65f0-43b6-89a4-94e306435350 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:42.444748 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e6b8a564-65f0-43b6-89a4-94e306435350 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:42.445198 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e6b8a564-65f0-43b6-89a4-94e306435350 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:42.445893 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e6b8a564-65f0-43b6-89a4-94e306435350 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:42.446356 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e6b8a564-65f0-43b6-89a4-94e306435350 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:42.446786 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e6b8a564-65f0-43b6-89a4-94e306435350 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:42.575643 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-e6b8a564-65f0-43b6-89a4-94e306435350 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:42.583853 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-e6b8a564-65f0-43b6-89a4-94e306435350 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1657 microversion: 2.1 time: 0.151132 Sep 25 04:41:42.584497 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 313/679] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:42 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1657 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:42.608309 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-7523959e-95cf-4c78-8f5b-c2e474c8e011 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:41:42.616135 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7523959e-95cf-4c78-8f5b-c2e474c8e011 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:42.616615 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7523959e-95cf-4c78-8f5b-c2e474c8e011 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:42.617132 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7523959e-95cf-4c78-8f5b-c2e474c8e011 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:42.641627 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-7523959e-95cf-4c78-8f5b-c2e474c8e011 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Going to try to start instance {{(pid=127142) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 25 04:41:42.688711 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-7523959e-95cf-4c78-8f5b-c2e474c8e011 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "POST /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632/action" status: 202 len: 0 microversion: 2.1 time: 0.084068 Sep 25 04:41:42.692427 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 367/680] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 25 04:41:42 2022] POST /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 04:41:42.698321 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-954e6d40-abba-48e8-9df6-ade4be7d52dd tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:42.699071 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-954e6d40-abba-48e8-9df6-ade4be7d52dd tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:42.705588 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-954e6d40-abba-48e8-9df6-ade4be7d52dd tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:42.706212 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-954e6d40-abba-48e8-9df6-ade4be7d52dd tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:42.707106 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-954e6d40-abba-48e8-9df6-ade4be7d52dd tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:42.708024 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-954e6d40-abba-48e8-9df6-ade4be7d52dd tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:42.708507 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-954e6d40-abba-48e8-9df6-ade4be7d52dd tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:42.708961 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-954e6d40-abba-48e8-9df6-ade4be7d52dd tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:42.802550 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-42a2bf6e-3d37-4653-a1ad-8ee35cab51ee tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:42.803299 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-42a2bf6e-3d37-4653-a1ad-8ee35cab51ee tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: a88affa4-277d-4c8f-b8ab-5b9fca9e12ec] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:42.819712 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-42a2bf6e-3d37-4653-a1ad-8ee35cab51ee tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:42.820213 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-42a2bf6e-3d37-4653-a1ad-8ee35cab51ee tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:42.820663 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-42a2bf6e-3d37-4653-a1ad-8ee35cab51ee tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:42.821379 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-42a2bf6e-3d37-4653-a1ad-8ee35cab51ee tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:42.823357 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-42a2bf6e-3d37-4653-a1ad-8ee35cab51ee tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:42.823794 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-42a2bf6e-3d37-4653-a1ad-8ee35cab51ee tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:42.918887 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-954e6d40-abba-48e8-9df6-ade4be7d52dd tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:42.928317 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-954e6d40-abba-48e8-9df6-ade4be7d52dd tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1666 microversion: 2.1 time: 0.233936 Sep 25 04:41:42.929241 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 314/681] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:42 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1666 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:42.941880 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-c03c9bc4-8194-429d-9f93-37395bed3d70 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:42.943379 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-c03c9bc4-8194-429d-9f93-37395bed3d70 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:42.951675 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c03c9bc4-8194-429d-9f93-37395bed3d70 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:42.952616 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c03c9bc4-8194-429d-9f93-37395bed3d70 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:42.953532 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c03c9bc4-8194-429d-9f93-37395bed3d70 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:42.954607 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c03c9bc4-8194-429d-9f93-37395bed3d70 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:42.955283 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c03c9bc4-8194-429d-9f93-37395bed3d70 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:42.956746 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c03c9bc4-8194-429d-9f93-37395bed3d70 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:43.103546 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-42a2bf6e-3d37-4653-a1ad-8ee35cab51ee tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:43.112414 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-42a2bf6e-3d37-4653-a1ad-8ee35cab51ee tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec" status: 200 len: 1265 microversion: 2.1 time: 0.314461 Sep 25 04:41:43.113450 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 368/682] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:42 2022] GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec => generated 1265 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:41:43.216774 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-c03c9bc4-8194-429d-9f93-37395bed3d70 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:43.225692 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-c03c9bc4-8194-429d-9f93-37395bed3d70 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1757 microversion: 2.1 time: 0.289431 Sep 25 04:41:43.226275 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 315/683] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:42 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1757 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:43.952318 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-937cd39e-66f6-45ab-ac60-af60863ad223 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:43.952966 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-937cd39e-66f6-45ab-ac60-af60863ad223 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:43.959645 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-937cd39e-66f6-45ab-ac60-af60863ad223 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:43.960136 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-937cd39e-66f6-45ab-ac60-af60863ad223 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:43.960573 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-937cd39e-66f6-45ab-ac60-af60863ad223 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:43.961575 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-937cd39e-66f6-45ab-ac60-af60863ad223 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:43.962034 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-937cd39e-66f6-45ab-ac60-af60863ad223 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:43.962462 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-937cd39e-66f6-45ab-ac60-af60863ad223 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:44.093302 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-937cd39e-66f6-45ab-ac60-af60863ad223 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:44.101722 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-937cd39e-66f6-45ab-ac60-af60863ad223 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1666 microversion: 2.1 time: 0.153242 Sep 25 04:41:44.102292 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 369/684] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:43 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1666 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:44.135245 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-713fedb7-4e11-4a01-9fd9-0e2928b20a6f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:44.135850 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-713fedb7-4e11-4a01-9fd9-0e2928b20a6f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: a88affa4-277d-4c8f-b8ab-5b9fca9e12ec] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:44.145462 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-713fedb7-4e11-4a01-9fd9-0e2928b20a6f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:44.146028 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-713fedb7-4e11-4a01-9fd9-0e2928b20a6f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:44.146511 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-713fedb7-4e11-4a01-9fd9-0e2928b20a6f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:44.147231 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-713fedb7-4e11-4a01-9fd9-0e2928b20a6f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:44.147698 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-713fedb7-4e11-4a01-9fd9-0e2928b20a6f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:44.148134 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-713fedb7-4e11-4a01-9fd9-0e2928b20a6f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:44.249061 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-c0b7f88f-b197-4c18-96ca-b93c4bf573ad tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:44.249845 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-c0b7f88f-b197-4c18-96ca-b93c4bf573ad tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:44.255885 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c0b7f88f-b197-4c18-96ca-b93c4bf573ad tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:44.256371 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c0b7f88f-b197-4c18-96ca-b93c4bf573ad tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:44.256852 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c0b7f88f-b197-4c18-96ca-b93c4bf573ad tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:44.257546 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c0b7f88f-b197-4c18-96ca-b93c4bf573ad tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:44.258006 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c0b7f88f-b197-4c18-96ca-b93c4bf573ad tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:44.258435 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c0b7f88f-b197-4c18-96ca-b93c4bf573ad tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:44.293984 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-713fedb7-4e11-4a01-9fd9-0e2928b20a6f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:44.303222 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-713fedb7-4e11-4a01-9fd9-0e2928b20a6f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec" status: 200 len: 1265 microversion: 2.1 time: 0.171714 Sep 25 04:41:44.303952 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 316/685] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:44 2022] GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:44.400719 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-c0b7f88f-b197-4c18-96ca-b93c4bf573ad tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:44.408961 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-c0b7f88f-b197-4c18-96ca-b93c4bf573ad tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1757 microversion: 2.1 time: 0.163688 Sep 25 04:41:44.410096 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 370/686] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:44 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:41:44.774519 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [req-5cd41a3c-7e10-428f-9c50-a9f9375a63ed req-9a00cf5a-f97f-4820-a906-5165f1e7e6bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a88affa4-277d-4c8f-b8ab-5b9fca9e12ec", "name": "network-vif-plugged", "status": "completed", "tag": "d940c3fc-ea28-4472-a65e-66e192fca8c0"}]} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:41:44.784534 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-5cd41a3c-7e10-428f-9c50-a9f9375a63ed req-9a00cf5a-f97f-4820-a906-5165f1e7e6bc service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:44.785329 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-5cd41a3c-7e10-428f-9c50-a9f9375a63ed req-9a00cf5a-f97f-4820-a906-5165f1e7e6bc service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:44.785762 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-5cd41a3c-7e10-428f-9c50-a9f9375a63ed req-9a00cf5a-f97f-4820-a906-5165f1e7e6bc service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:44.797651 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.compute.server_external_events [req-5cd41a3c-7e10-428f-9c50-a9f9375a63ed req-9a00cf5a-f97f-4820-a906-5165f1e7e6bc service nova] Creating event network-vif-plugged:d940c3fc-ea28-4472-a65e-66e192fca8c0 for instance a88affa4-277d-4c8f-b8ab-5b9fca9e12ec on hv-cinder-85535 Sep 25 04:41:44.802998 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [req-5cd41a3c-7e10-428f-9c50-a9f9375a63ed req-9a00cf5a-f97f-4820-a906-5165f1e7e6bc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097212 Sep 25 04:41:44.803579 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 317/687] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:41:45.126119 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-6393d85c-e51c-4c6e-8dc3-e111874a6873 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:45.126669 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-6393d85c-e51c-4c6e-8dc3-e111874a6873 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:45.134290 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6393d85c-e51c-4c6e-8dc3-e111874a6873 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:45.134876 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6393d85c-e51c-4c6e-8dc3-e111874a6873 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:45.135297 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6393d85c-e51c-4c6e-8dc3-e111874a6873 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:45.136059 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6393d85c-e51c-4c6e-8dc3-e111874a6873 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:45.136625 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6393d85c-e51c-4c6e-8dc3-e111874a6873 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:45.137108 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6393d85c-e51c-4c6e-8dc3-e111874a6873 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:45.277450 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-6393d85c-e51c-4c6e-8dc3-e111874a6873 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:45.287229 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-6393d85c-e51c-4c6e-8dc3-e111874a6873 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1670 microversion: 2.1 time: 0.164776 Sep 25 04:41:45.287775 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 371/688] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:45 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1670 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:45.327783 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-16e566cc-1fcd-4e85-ab86-841ad296fd4c tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:45.328699 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-16e566cc-1fcd-4e85-ab86-841ad296fd4c tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: a88affa4-277d-4c8f-b8ab-5b9fca9e12ec] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:45.338687 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-16e566cc-1fcd-4e85-ab86-841ad296fd4c tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:45.339171 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-16e566cc-1fcd-4e85-ab86-841ad296fd4c tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:45.339640 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-16e566cc-1fcd-4e85-ab86-841ad296fd4c tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:45.340343 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-16e566cc-1fcd-4e85-ab86-841ad296fd4c tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:45.340839 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-16e566cc-1fcd-4e85-ab86-841ad296fd4c tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:45.341261 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-16e566cc-1fcd-4e85-ab86-841ad296fd4c tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:45.434751 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-c81c7043-f196-476e-a9cb-e51ddead4eaa tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:45.435550 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-c81c7043-f196-476e-a9cb-e51ddead4eaa tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:45.442822 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c81c7043-f196-476e-a9cb-e51ddead4eaa tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:45.443423 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c81c7043-f196-476e-a9cb-e51ddead4eaa tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:45.443934 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c81c7043-f196-476e-a9cb-e51ddead4eaa tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:45.444749 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c81c7043-f196-476e-a9cb-e51ddead4eaa tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:45.445286 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c81c7043-f196-476e-a9cb-e51ddead4eaa tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:45.445745 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c81c7043-f196-476e-a9cb-e51ddead4eaa tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:45.597791 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-16e566cc-1fcd-4e85-ab86-841ad296fd4c tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:45.610369 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-16e566cc-1fcd-4e85-ab86-841ad296fd4c tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec" status: 200 len: 1265 microversion: 2.1 time: 0.286626 Sep 25 04:41:45.611270 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 318/689] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:45 2022] GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec => generated 1265 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:41:45.653068 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-c81c7043-f196-476e-a9cb-e51ddead4eaa tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:45.663011 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-c81c7043-f196-476e-a9cb-e51ddead4eaa tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1757 microversion: 2.1 time: 0.231910 Sep 25 04:41:45.664052 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 372/690] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:45 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1757 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:41:46.633829 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-f14c898f-e3f2-44bf-abad-8b45e349ebbf tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:46.634441 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-f14c898f-e3f2-44bf-abad-8b45e349ebbf tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: a88affa4-277d-4c8f-b8ab-5b9fca9e12ec] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:46.640901 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f14c898f-e3f2-44bf-abad-8b45e349ebbf tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:46.641391 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f14c898f-e3f2-44bf-abad-8b45e349ebbf tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:46.641831 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f14c898f-e3f2-44bf-abad-8b45e349ebbf tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:46.642521 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f14c898f-e3f2-44bf-abad-8b45e349ebbf tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:46.642976 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f14c898f-e3f2-44bf-abad-8b45e349ebbf tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:46.643406 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f14c898f-e3f2-44bf-abad-8b45e349ebbf tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:46.687294 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-20876199-2a93-4588-a517-2d906e48702e tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:46.688016 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-20876199-2a93-4588-a517-2d906e48702e tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:46.694986 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-20876199-2a93-4588-a517-2d906e48702e tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:46.695551 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-20876199-2a93-4588-a517-2d906e48702e tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:46.696065 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-20876199-2a93-4588-a517-2d906e48702e tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:46.696882 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-20876199-2a93-4588-a517-2d906e48702e tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:46.697414 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-20876199-2a93-4588-a517-2d906e48702e tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:46.697936 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-20876199-2a93-4588-a517-2d906e48702e tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:46.827286 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-f14c898f-e3f2-44bf-abad-8b45e349ebbf tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:46.835204 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-f14c898f-e3f2-44bf-abad-8b45e349ebbf tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec" status: 200 len: 1265 microversion: 2.1 time: 0.205250 Sep 25 04:41:46.835779 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 319/691] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:46 2022] GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:46.872839 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-20876199-2a93-4588-a517-2d906e48702e tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:46.881816 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-20876199-2a93-4588-a517-2d906e48702e tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1757 microversion: 2.1 time: 0.198407 Sep 25 04:41:46.882379 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 373/692] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:46 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1757 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:41:47.858215 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-7d0acfd7-6d1e-4f07-9244-681d13b0e76a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:47.858831 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-7d0acfd7-6d1e-4f07-9244-681d13b0e76a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: a88affa4-277d-4c8f-b8ab-5b9fca9e12ec] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:47.865350 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7d0acfd7-6d1e-4f07-9244-681d13b0e76a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:47.865834 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7d0acfd7-6d1e-4f07-9244-681d13b0e76a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:47.866269 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7d0acfd7-6d1e-4f07-9244-681d13b0e76a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:47.866955 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7d0acfd7-6d1e-4f07-9244-681d13b0e76a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:47.867411 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7d0acfd7-6d1e-4f07-9244-681d13b0e76a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:47.867837 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7d0acfd7-6d1e-4f07-9244-681d13b0e76a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:47.904702 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-56640899-1a4e-474a-b347-324eff04aed9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:47.905427 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-56640899-1a4e-474a-b347-324eff04aed9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:47.912192 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-56640899-1a4e-474a-b347-324eff04aed9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:47.912832 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-56640899-1a4e-474a-b347-324eff04aed9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:47.913339 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-56640899-1a4e-474a-b347-324eff04aed9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:47.914095 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-56640899-1a4e-474a-b347-324eff04aed9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:47.914618 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-56640899-1a4e-474a-b347-324eff04aed9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:47.915104 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-56640899-1a4e-474a-b347-324eff04aed9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:48.049716 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-7d0acfd7-6d1e-4f07-9244-681d13b0e76a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:48.063763 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-7d0acfd7-6d1e-4f07-9244-681d13b0e76a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec" status: 200 len: 1265 microversion: 2.1 time: 0.208922 Sep 25 04:41:48.073051 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 320/693] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:47 2022] GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec => generated 1265 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:48.105328 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-56640899-1a4e-474a-b347-324eff04aed9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:48.114442 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-56640899-1a4e-474a-b347-324eff04aed9 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1757 microversion: 2.1 time: 0.213537 Sep 25 04:41:48.115102 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 374/694] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:47 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1757 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:41:49.087970 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-64bec397-e826-456c-bae0-a09cc32c78ed tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:49.088521 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-64bec397-e826-456c-bae0-a09cc32c78ed tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: a88affa4-277d-4c8f-b8ab-5b9fca9e12ec] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:49.094883 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-64bec397-e826-456c-bae0-a09cc32c78ed tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:49.095381 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-64bec397-e826-456c-bae0-a09cc32c78ed tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:49.095824 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-64bec397-e826-456c-bae0-a09cc32c78ed tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:49.096549 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-64bec397-e826-456c-bae0-a09cc32c78ed tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:49.097121 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-64bec397-e826-456c-bae0-a09cc32c78ed tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:49.097557 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-64bec397-e826-456c-bae0-a09cc32c78ed tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:49.139166 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-d85cbedb-3d88-405b-a5c4-f0f9743e10ff tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:49.139782 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-d85cbedb-3d88-405b-a5c4-f0f9743e10ff tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:49.146524 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d85cbedb-3d88-405b-a5c4-f0f9743e10ff tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:49.147016 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d85cbedb-3d88-405b-a5c4-f0f9743e10ff tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:49.147458 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d85cbedb-3d88-405b-a5c4-f0f9743e10ff tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:49.148156 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d85cbedb-3d88-405b-a5c4-f0f9743e10ff tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:49.148609 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d85cbedb-3d88-405b-a5c4-f0f9743e10ff tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:49.149063 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d85cbedb-3d88-405b-a5c4-f0f9743e10ff tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:49.281145 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-64bec397-e826-456c-bae0-a09cc32c78ed tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:49.291267 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-64bec397-e826-456c-bae0-a09cc32c78ed tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec" status: 200 len: 1452 microversion: 2.1 time: 0.207515 Sep 25 04:41:49.292012 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 321/695] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:49 2022] GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec => generated 1452 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:41:49.314103 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-da48c9f8-906b-4fb9-b5f5-8da994bde5a5 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:41:49.314703 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-da48c9f8-906b-4fb9-b5f5-8da994bde5a5 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: a88affa4-277d-4c8f-b8ab-5b9fca9e12ec] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:41:49.320591 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-d85cbedb-3d88-405b-a5c4-f0f9743e10ff tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:49.320890 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-da48c9f8-906b-4fb9-b5f5-8da994bde5a5 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:49.321382 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-da48c9f8-906b-4fb9-b5f5-8da994bde5a5 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:49.321813 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-da48c9f8-906b-4fb9-b5f5-8da994bde5a5 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:49.322503 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-da48c9f8-906b-4fb9-b5f5-8da994bde5a5 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:49.322951 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-da48c9f8-906b-4fb9-b5f5-8da994bde5a5 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:49.323376 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-da48c9f8-906b-4fb9-b5f5-8da994bde5a5 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:49.329010 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-d85cbedb-3d88-405b-a5c4-f0f9743e10ff tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1760 microversion: 2.1 time: 0.193658 Sep 25 04:41:49.329573 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 375/696] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:49 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1760 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:41:49.461604 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-da48c9f8-906b-4fb9-b5f5-8da994bde5a5 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:41:49.469462 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-da48c9f8-906b-4fb9-b5f5-8da994bde5a5 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec" status: 200 len: 1452 microversion: 2.1 time: 0.159055 Sep 25 04:41:49.470031 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 322/697] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:41:49 2022] GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:41:51.273503 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-d38841f6-4554-4921-ace9-d35b24ab795e req-401e94c6-8783-4bae-8dd2-69da9436bcbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a88affa4-277d-4c8f-b8ab-5b9fca9e12ec", "tag": "d940c3fc-ea28-4472-a65e-66e192fca8c0"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:41:51.287588 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-d38841f6-4554-4921-ace9-d35b24ab795e req-401e94c6-8783-4bae-8dd2-69da9436bcbe service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:41:51.288285 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-d38841f6-4554-4921-ace9-d35b24ab795e req-401e94c6-8783-4bae-8dd2-69da9436bcbe service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:41:51.288814 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-d38841f6-4554-4921-ace9-d35b24ab795e req-401e94c6-8783-4bae-8dd2-69da9436bcbe service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:41:51.302554 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-d38841f6-4554-4921-ace9-d35b24ab795e req-401e94c6-8783-4bae-8dd2-69da9436bcbe service nova] Creating event network-changed:d940c3fc-ea28-4472-a65e-66e192fca8c0 for instance a88affa4-277d-4c8f-b8ab-5b9fca9e12ec on hv-cinder-85535 Sep 25 04:41:51.308521 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-d38841f6-4554-4921-ace9-d35b24ab795e req-401e94c6-8783-4bae-8dd2-69da9436bcbe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039690 Sep 25 04:41:51.309505 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 376/698] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:42:16.928937 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_api:SELECT=37 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:42:16.929689 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=73 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:42:16.981391 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-410d5c75-44d0-4a00-bb0b-f7a9a9c09291 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:16.981884 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-410d5c75-44d0-4a00-bb0b-f7a9a9c09291 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: e1e1377c-3c28-46cb-9832-cebf5ad33679] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:16.987882 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-410d5c75-44d0-4a00-bb0b-f7a9a9c09291 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:16.988498 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-410d5c75-44d0-4a00-bb0b-f7a9a9c09291 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:16.989059 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-410d5c75-44d0-4a00-bb0b-f7a9a9c09291 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:16.989747 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-410d5c75-44d0-4a00-bb0b-f7a9a9c09291 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:16.990202 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-410d5c75-44d0-4a00-bb0b-f7a9a9c09291 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:16.990690 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-410d5c75-44d0-4a00-bb0b-f7a9a9c09291 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:17.013868 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-410d5c75-44d0-4a00-bb0b-f7a9a9c09291 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679/ips" status: 200 len: 150 microversion: 2.1 time: 0.090623 Sep 25 04:42:17.014576 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 323/699] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Sep 25 04:42:16 2022] GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679/ips => generated 150 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:42:17.024978 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_api:SELECT=41 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:42:17.025649 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:42:17.030638 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-b7dcefee-d9ee-4f51-b566-2859018184a3 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd9f3650-aa8a-4f8e-8412-cd5409e73a80"}} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:42:17.033061 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-b7dcefee-d9ee-4f51-b566-2859018184a3 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: e1e1377c-3c28-46cb-9832-cebf5ad33679] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:17.041268 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b7dcefee-d9ee-4f51-b566-2859018184a3 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:17.041749 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b7dcefee-d9ee-4f51-b566-2859018184a3 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:17.042182 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b7dcefee-d9ee-4f51-b566-2859018184a3 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:17.042863 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b7dcefee-d9ee-4f51-b566-2859018184a3 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:17.043314 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b7dcefee-d9ee-4f51-b566-2859018184a3 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:17.043733 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b7dcefee-d9ee-4f51-b566-2859018184a3 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:17.123748 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.wsgi [None req-b7dcefee-d9ee-4f51-b566-2859018184a3 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] HTTP exception thrown: Invalid volume: volume cd9f3650-aa8a-4f8e-8412-cd5409e73a80 is already attached to instances: a31d3c84-7c72-4a2c-970c-b58e15f431f1 Sep 25 04:42:17.125488 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-b7dcefee-d9ee-4f51-b566-2859018184a3 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Request method failure captured: Sep 25 04:42:17.125488 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: request: POST /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679/os-volume_attachments HTTP/1.1 Sep 25 04:42:17.125488 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept: application/json Sep 25 04:42:17.125488 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept-Encoding: identity Sep 25 04:42:17.125488 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Connection: close Sep 25 04:42:17.125488 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Length: 74 Sep 25 04:42:17.125488 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Type: application/json Sep 25 04:42:17.125488 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Host: 10.222.0.25 Sep 25 04:42:17.125488 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Openstack-System-Scope: None Sep 25 04:42:17.125488 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: User-Agent: python-urllib3/1.26.12 Sep 25 04:42:17.125488 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Auth-Token: gAAAAABjL9qrZElSae56-vG92SlYq1mROXWpWxGFTOD54wjMJs5cfOlxoWE8oAX6RsHfzZAezv5xiCHlYRD_dbdLKAb4-UUsE_8Gy0JkuMwbWForQ70ZIoDPfES94_73P9FeYeuBsh7sfePpFsox-IWSco1U62FJ77nXfz6wXdXOU1pyUSzZLWo Sep 25 04:42:17.125488 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Id: None Sep 25 04:42:17.125488 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Name: None Sep 25 04:42:17.125488 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Identity-Status: Confirmed Sep 25 04:42:17.125488 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Is-Admin-Project: True Sep 25 04:42:17.125488 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Id: default Sep 25 04:42:17.125488 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Name: Default Sep 25 04:42:17.125488 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Id: 5ead2221f7f54d6cbea9fc086a089342 Sep 25 04:42:17.125488 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Name: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:42:17.125488 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Role: reader,member Sep 25 04:42:17.125488 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Roles: reader,member Sep 25 04:42:17.126999 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5ead2221f7f54d6cbea9fc086a089342"}]}] Sep 25 04:42:17.126999 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:42:17.126999 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Id: 5ead2221f7f54d6cbea9fc086a089342 Sep 25 04:42:17.126999 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:42:17.126999 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User: tempest-AttachVolumeNegativeTest-1212083561-project Sep 25 04:42:17.126999 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Id: default Sep 25 04:42:17.126999 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Name: Default Sep 25 04:42:17.126999 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Id: c50ba6f9a164463eae9a248936e7bf80 Sep 25 04:42:17.126999 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Name: tempest-AttachVolumeNegativeTest-1212083561-project Sep 25 04:42:17.126999 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Sep 25 04:42:17.126999 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: {"volumeAttachment": {"volumeId": "cd9f3650-aa8a-4f8e-8412-cd5409e73a80"}} Sep 25 04:42:17.126999 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: method: > Sep 25 04:42:17.127874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: exception: Invalid volume: volume cd9f3650-aa8a-4f8e-8412-cd5409e73a80 is already attached to instances: a31d3c84-7c72-4a2c-970c-b58e15f431f1 Sep 25 04:42:17.127874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: action_args: {'server_id': 'e1e1377c-3c28-46cb-9832-cebf5ad33679', 'body': {'volumeAttachment': {'volumeId': 'cd9f3650-aa8a-4f8e-8412-cd5409e73a80'}}} Sep 25 04:42:17.127874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:42:17.127874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:42:17.127874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 25 04:42:17.127874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 25 04:42:17.127874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 25 04:42:17.127874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 25 04:42:17.127874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 25 04:42:17.127874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 25 04:42:17.127874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 25 04:42:17.127874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 25 04:42:17.127874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 25 04:42:17.127874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 25 04:42:17.127874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cd9f3650-aa8a-4f8e-8412-cd5409e73a80 is already attached to instances: a31d3c84-7c72-4a2c-970c-b58e15f431f1 Sep 25 04:42:17.127874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:42:17.127874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:42:17.127874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:42:17.127874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:42:17.130210 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:42:17.130210 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:42:17.130210 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:42:17.130210 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:42:17.130210 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:42:17.130210 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:42:17.130210 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 04:42:17.130210 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 04:42:17.130210 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 04:42:17.130210 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 04:42:17.130210 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 04:42:17.130210 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 04:42:17.130210 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 25 04:42:17.130210 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 25 04:42:17.130210 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cd9f3650-aa8a-4f8e-8412-cd5409e73a80 is already attached to instances: a31d3c84-7c72-4a2c-970c-b58e15f431f1 Sep 25 04:42:17.130210 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:42:17.130210 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:42:17.130210 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:42:17.130210 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:42:17.130210 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:42:17.131863 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:42:17.131863 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:42:17.131863 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:42:17.131863 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cd9f3650-aa8a-4f8e-8412-cd5409e73a80 is already attached to instances: a31d3c84-7c72-4a2c-970c-b58e15f431f1 Sep 25 04:42:17.131863 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:42:17.131863 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-b7dcefee-d9ee-4f51-b566-2859018184a3 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Returning 400 to user: Invalid volume: volume cd9f3650-aa8a-4f8e-8412-cd5409e73a80 is already attached to instances: a31d3c84-7c72-4a2c-970c-b58e15f431f1 {{(pid=127142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:42:17.131863 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-b7dcefee-d9ee-4f51-b566-2859018184a3 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "POST /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103677 Sep 25 04:42:17.131863 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 377/700] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Sep 25 04:42:17 2022] POST /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 04:42:17.136752 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-dbe133c8-7683-474c-bced-79c7d091e987 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:17.137253 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-dbe133c8-7683-474c-bced-79c7d091e987 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: e1e1377c-3c28-46cb-9832-cebf5ad33679] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:17.143162 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-dbe133c8-7683-474c-bced-79c7d091e987 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:17.143652 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-dbe133c8-7683-474c-bced-79c7d091e987 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:17.144093 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-dbe133c8-7683-474c-bced-79c7d091e987 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:17.145522 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-dbe133c8-7683-474c-bced-79c7d091e987 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:17.145986 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-dbe133c8-7683-474c-bced-79c7d091e987 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:17.146416 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-dbe133c8-7683-474c-bced-79c7d091e987 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:17.170851 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-dbe133c8-7683-474c-bced-79c7d091e987 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: e1e1377c-3c28-46cb-9832-cebf5ad33679] Going to try to terminate instance {{(pid=127141) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 04:42:17.245215 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-dbe133c8-7683-474c-bced-79c7d091e987 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679" status: 204 len: 0 microversion: 2.1 time: 0.112152 Sep 25 04:42:17.245781 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 324/701] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 25 04:42:17 2022] DELETE /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 04:42:17.254693 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-2c22b449-3f69-4a50-9461-6ba01352b640 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:17.255535 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-2c22b449-3f69-4a50-9461-6ba01352b640 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: e1e1377c-3c28-46cb-9832-cebf5ad33679] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:17.262121 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2c22b449-3f69-4a50-9461-6ba01352b640 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:17.262598 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2c22b449-3f69-4a50-9461-6ba01352b640 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:17.263028 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2c22b449-3f69-4a50-9461-6ba01352b640 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:17.263711 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2c22b449-3f69-4a50-9461-6ba01352b640 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:17.264159 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2c22b449-3f69-4a50-9461-6ba01352b640 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:17.264582 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2c22b449-3f69-4a50-9461-6ba01352b640 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:17.395331 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-2c22b449-3f69-4a50-9461-6ba01352b640 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:17.402872 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-2c22b449-3f69-4a50-9461-6ba01352b640 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679" status: 200 len: 1683 microversion: 2.1 time: 0.152777 Sep 25 04:42:17.403424 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 378/702] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:42:17 2022] GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:42:18.427327 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-6c728c37-c514-4248-a1ed-addec3f2a8b4 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:18.428028 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-6c728c37-c514-4248-a1ed-addec3f2a8b4 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: e1e1377c-3c28-46cb-9832-cebf5ad33679] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:18.434383 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6c728c37-c514-4248-a1ed-addec3f2a8b4 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:18.434858 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6c728c37-c514-4248-a1ed-addec3f2a8b4 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:18.435291 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6c728c37-c514-4248-a1ed-addec3f2a8b4 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:18.435964 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6c728c37-c514-4248-a1ed-addec3f2a8b4 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:18.436411 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6c728c37-c514-4248-a1ed-addec3f2a8b4 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:18.436856 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6c728c37-c514-4248-a1ed-addec3f2a8b4 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:18.565606 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-6c728c37-c514-4248-a1ed-addec3f2a8b4 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:18.573383 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-6c728c37-c514-4248-a1ed-addec3f2a8b4 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679" status: 200 len: 1683 microversion: 2.1 time: 0.151200 Sep 25 04:42:18.573937 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 325/703] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:42:18 2022] GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:42:19.597135 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-fac22bfa-1ada-484f-b58e-579027cf51fd tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:19.597752 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-fac22bfa-1ada-484f-b58e-579027cf51fd tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: e1e1377c-3c28-46cb-9832-cebf5ad33679] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:19.604155 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fac22bfa-1ada-484f-b58e-579027cf51fd tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:19.604669 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fac22bfa-1ada-484f-b58e-579027cf51fd tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:19.605102 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fac22bfa-1ada-484f-b58e-579027cf51fd tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:19.605817 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fac22bfa-1ada-484f-b58e-579027cf51fd tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:19.606272 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fac22bfa-1ada-484f-b58e-579027cf51fd tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:19.606693 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fac22bfa-1ada-484f-b58e-579027cf51fd tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:19.833096 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-fac22bfa-1ada-484f-b58e-579027cf51fd tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:19.840988 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-fac22bfa-1ada-484f-b58e-579027cf51fd tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679" status: 200 len: 1683 microversion: 2.1 time: 0.247897 Sep 25 04:42:19.841770 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 379/704] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:42:19 2022] GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679 => generated 1683 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:42:20.331166 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [req-8257263b-0aa1-45f1-a6ce-936b96bdca06 req-70cb405a-f5bc-4783-839e-79d2d2d978d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1e1377c-3c28-46cb-9832-cebf5ad33679", "name": "network-vif-deleted", "tag": "8d8f9d96-eeac-4835-8074-648560fb1d09"}]} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:42:20.347388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-8257263b-0aa1-45f1-a6ce-936b96bdca06 req-70cb405a-f5bc-4783-839e-79d2d2d978d3 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:20.348503 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-8257263b-0aa1-45f1-a6ce-936b96bdca06 req-70cb405a-f5bc-4783-839e-79d2d2d978d3 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:20.349051 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-8257263b-0aa1-45f1-a6ce-936b96bdca06 req-70cb405a-f5bc-4783-839e-79d2d2d978d3 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:20.364352 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.compute.server_external_events [req-8257263b-0aa1-45f1-a6ce-936b96bdca06 req-70cb405a-f5bc-4783-839e-79d2d2d978d3 service nova] Creating event network-vif-deleted:8d8f9d96-eeac-4835-8074-648560fb1d09 for instance e1e1377c-3c28-46cb-9832-cebf5ad33679 on hv-cinder-85535 Sep 25 04:42:20.371657 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [req-8257263b-0aa1-45f1-a6ce-936b96bdca06 req-70cb405a-f5bc-4783-839e-79d2d2d978d3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044877 Sep 25 04:42:20.372345 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 326/705] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:42:20.864579 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-4e2c0efb-694c-4a2e-a6b5-c4d38b977261 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:20.865351 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-4e2c0efb-694c-4a2e-a6b5-c4d38b977261 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: e1e1377c-3c28-46cb-9832-cebf5ad33679] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:20.871936 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4e2c0efb-694c-4a2e-a6b5-c4d38b977261 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:20.872498 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4e2c0efb-694c-4a2e-a6b5-c4d38b977261 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:20.872964 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4e2c0efb-694c-4a2e-a6b5-c4d38b977261 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:20.873662 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4e2c0efb-694c-4a2e-a6b5-c4d38b977261 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:20.874117 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4e2c0efb-694c-4a2e-a6b5-c4d38b977261 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:20.874556 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4e2c0efb-694c-4a2e-a6b5-c4d38b977261 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:20.907305 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4e2c0efb-694c-4a2e-a6b5-c4d38b977261 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:20.907714 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4e2c0efb-694c-4a2e-a6b5-c4d38b977261 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:20.908155 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4e2c0efb-694c-4a2e-a6b5-c4d38b977261 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:20.908614 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.objects.instance [None req-4e2c0efb-694c-4a2e-a6b5-c4d38b977261 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lazy-loading 'fault' on Instance uuid e1e1377c-3c28-46cb-9832-cebf5ad33679 {{(pid=127142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 04:42:20.952133 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-4e2c0efb-694c-4a2e-a6b5-c4d38b977261 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:20.960109 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-4e2c0efb-694c-4a2e-a6b5-c4d38b977261 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679" status: 200 len: 1332 microversion: 2.1 time: 0.100053 Sep 25 04:42:20.960704 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 380/706] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:42:20 2022] GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679 => generated 1332 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:42:21.984954 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-3326a824-b114-4755-89f9-0ab4c82f4a8d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:21.985650 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-3326a824-b114-4755-89f9-0ab4c82f4a8d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: e1e1377c-3c28-46cb-9832-cebf5ad33679] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:21.993051 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3326a824-b114-4755-89f9-0ab4c82f4a8d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:21.993535 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3326a824-b114-4755-89f9-0ab4c82f4a8d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:21.993975 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3326a824-b114-4755-89f9-0ab4c82f4a8d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:21.994664 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3326a824-b114-4755-89f9-0ab4c82f4a8d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:21.995120 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3326a824-b114-4755-89f9-0ab4c82f4a8d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:21.995550 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3326a824-b114-4755-89f9-0ab4c82f4a8d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:22.009335 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.wsgi [None req-3326a824-b114-4755-89f9-0ab4c82f4a8d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] HTTP exception thrown: Instance e1e1377c-3c28-46cb-9832-cebf5ad33679 could not be found. Sep 25 04:42:22.010928 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-3326a824-b114-4755-89f9-0ab4c82f4a8d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Request method failure captured: Sep 25 04:42:22.010928 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: request: GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679 HTTP/1.1 Sep 25 04:42:22.010928 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept: application/json Sep 25 04:42:22.010928 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept-Encoding: identity Sep 25 04:42:22.010928 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Connection: close Sep 25 04:42:22.010928 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Length: 0 Sep 25 04:42:22.010928 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Type: application/json Sep 25 04:42:22.010928 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Host: 10.222.0.25 Sep 25 04:42:22.010928 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Openstack-System-Scope: None Sep 25 04:42:22.010928 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: User-Agent: python-urllib3/1.26.12 Sep 25 04:42:22.010928 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Auth-Token: gAAAAABjL9qrZElSae56-vG92SlYq1mROXWpWxGFTOD54wjMJs5cfOlxoWE8oAX6RsHfzZAezv5xiCHlYRD_dbdLKAb4-UUsE_8Gy0JkuMwbWForQ70ZIoDPfES94_73P9FeYeuBsh7sfePpFsox-IWSco1U62FJ77nXfz6wXdXOU1pyUSzZLWo Sep 25 04:42:22.010928 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Id: None Sep 25 04:42:22.010928 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Name: None Sep 25 04:42:22.010928 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Identity-Status: Confirmed Sep 25 04:42:22.010928 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Is-Admin-Project: True Sep 25 04:42:22.010928 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Id: default Sep 25 04:42:22.010928 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Name: Default Sep 25 04:42:22.010928 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Id: 5ead2221f7f54d6cbea9fc086a089342 Sep 25 04:42:22.010928 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Name: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:42:22.010928 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Role: reader,member Sep 25 04:42:22.010928 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Roles: reader,member Sep 25 04:42:22.012460 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5ead2221f7f54d6cbea9fc086a089342"}]}] Sep 25 04:42:22.012460 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:42:22.012460 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Id: 5ead2221f7f54d6cbea9fc086a089342 Sep 25 04:42:22.012460 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:42:22.012460 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User: tempest-AttachVolumeNegativeTest-1212083561-project Sep 25 04:42:22.012460 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Id: default Sep 25 04:42:22.012460 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Name: Default Sep 25 04:42:22.012460 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Id: c50ba6f9a164463eae9a248936e7bf80 Sep 25 04:42:22.012460 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Name: tempest-AttachVolumeNegativeTest-1212083561-project Sep 25 04:42:22.012460 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: method: > Sep 25 04:42:22.012460 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: exception: Instance e1e1377c-3c28-46cb-9832-cebf5ad33679 could not be found. Sep 25 04:42:22.012460 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: action_args: {'id': 'e1e1377c-3c28-46cb-9832-cebf5ad33679'} Sep 25 04:42:22.013388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:42:22.013388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:42:22.013388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:42:22.013388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:42:22.013388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:42:22.013388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:42:22.013388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:42:22.013388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:42:22.013388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:42:22.013388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:42:22.013388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1e1377c-3c28-46cb-9832-cebf5ad33679 could not be found. Sep 25 04:42:22.013388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:42:22.013388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:42:22.013388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:42:22.013388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:42:22.013388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:42:22.013388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:42:22.013388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:42:22.013388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:42:22.013388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:42:22.014843 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:42:22.014843 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 04:42:22.014843 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 04:42:22.014843 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:42:22.014843 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:42:22.014843 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:42:22.014843 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:42:22.014843 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1e1377c-3c28-46cb-9832-cebf5ad33679 could not be found. Sep 25 04:42:22.014843 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:42:22.014843 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:42:22.014843 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:42:22.014843 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:42:22.014843 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:42:22.014843 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:42:22.014843 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:42:22.014843 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:42:22.014843 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1e1377c-3c28-46cb-9832-cebf5ad33679 could not be found. Sep 25 04:42:22.014843 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:42:22.016151 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-3326a824-b114-4755-89f9-0ab4c82f4a8d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Returning 404 to user: Instance e1e1377c-3c28-46cb-9832-cebf5ad33679 could not be found. {{(pid=127141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:42:22.016151 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-3326a824-b114-4755-89f9-0ab4c82f4a8d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679" status: 404 len: 111 microversion: 2.1 time: 0.031570 Sep 25 04:42:22.016151 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 327/707] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:42:21 2022] GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 04:42:22.021406 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-a8a9df9a-d18d-4c1f-afb2-b1acf538368b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '.version_select at 0x7f4d3eb5e4c0>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:22.040528 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-a8a9df9a-d18d-4c1f-afb2-b1acf538368b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1792938834" status: 202 len: 0 microversion: 2.1 time: 0.023108 Sep 25 04:42:22.041112 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 381/708] 10.222.0.25 () {58 vars in 1221 bytes} [Sun Sep 25 04:42:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1792938834 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 04:42:22.704831 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-4ac187ab-db80-4249-9db3-ac8ce0cf5b87 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:22.705321 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-4ac187ab-db80-4249-9db3-ac8ce0cf5b87 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:22.711246 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4ac187ab-db80-4249-9db3-ac8ce0cf5b87 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:22.711988 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4ac187ab-db80-4249-9db3-ac8ce0cf5b87 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:22.712420 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4ac187ab-db80-4249-9db3-ac8ce0cf5b87 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:22.713130 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4ac187ab-db80-4249-9db3-ac8ce0cf5b87 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:22.713581 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4ac187ab-db80-4249-9db3-ac8ce0cf5b87 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:22.714003 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4ac187ab-db80-4249-9db3-ac8ce0cf5b87 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:22.837813 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.objects.instance [None req-4ac187ab-db80-4249-9db3-ac8ce0cf5b87 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lazy-loading 'services' on Instance uuid a31d3c84-7c72-4a2c-970c-b58e15f431f1 {{(pid=127141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 04:42:22.951001 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-4ac187ab-db80-4249-9db3-ac8ce0cf5b87 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1/os-volume_attachments/cd9f3650-aa8a-4f8e-8412-cd5409e73a80" status: 202 len: 0 microversion: 2.1 time: 0.249875 Sep 25 04:42:22.951567 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 328/709] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Sep 25 04:42:22 2022] DELETE /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1/os-volume_attachments/cd9f3650-aa8a-4f8e-8412-cd5409e73a80 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 04:42:22.960292 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-de3ba2f2-e588-49fd-8c26-f38bd8399c98 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:22.962544 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-de3ba2f2-e588-49fd-8c26-f38bd8399c98 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:22.969702 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-de3ba2f2-e588-49fd-8c26-f38bd8399c98 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:22.970836 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-de3ba2f2-e588-49fd-8c26-f38bd8399c98 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:22.970836 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-de3ba2f2-e588-49fd-8c26-f38bd8399c98 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:22.971573 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-de3ba2f2-e588-49fd-8c26-f38bd8399c98 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:22.972744 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-de3ba2f2-e588-49fd-8c26-f38bd8399c98 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:22.973184 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-de3ba2f2-e588-49fd-8c26-f38bd8399c98 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:23.003639 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-de3ba2f2-e588-49fd-8c26-f38bd8399c98 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047460 Sep 25 04:42:23.004384 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 382/710] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 25 04:42:22 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:42:24.016451 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-a5a87c02-8ce9-4f03-888a-7e5a9e5410a8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:24.018780 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-a5a87c02-8ce9-4f03-888a-7e5a9e5410a8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:24.027201 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a5a87c02-8ce9-4f03-888a-7e5a9e5410a8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:24.027690 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a5a87c02-8ce9-4f03-888a-7e5a9e5410a8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:24.028130 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a5a87c02-8ce9-4f03-888a-7e5a9e5410a8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:24.028857 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a5a87c02-8ce9-4f03-888a-7e5a9e5410a8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:24.029316 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a5a87c02-8ce9-4f03-888a-7e5a9e5410a8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:24.029746 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a5a87c02-8ce9-4f03-888a-7e5a9e5410a8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:24.058798 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-a5a87c02-8ce9-4f03-888a-7e5a9e5410a8 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047120 Sep 25 04:42:24.059343 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 329/711] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 25 04:42:24 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:42:25.072326 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-805ef52c-22ca-4fb6-8ae8-d5eaa906081c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:25.074476 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-805ef52c-22ca-4fb6-8ae8-d5eaa906081c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:25.080896 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-805ef52c-22ca-4fb6-8ae8-d5eaa906081c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:25.081383 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-805ef52c-22ca-4fb6-8ae8-d5eaa906081c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:25.081824 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-805ef52c-22ca-4fb6-8ae8-d5eaa906081c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:25.082518 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-805ef52c-22ca-4fb6-8ae8-d5eaa906081c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:25.083018 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-805ef52c-22ca-4fb6-8ae8-d5eaa906081c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:25.083451 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-805ef52c-22ca-4fb6-8ae8-d5eaa906081c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:25.113654 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-805ef52c-22ca-4fb6-8ae8-d5eaa906081c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046101 Sep 25 04:42:25.114720 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 383/712] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 25 04:42:25 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 04:42:25.178552 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-cffeb33a-2eb9-4ed7-9751-4fa528dd3484 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:25.179036 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-cffeb33a-2eb9-4ed7-9751-4fa528dd3484 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:25.185313 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cffeb33a-2eb9-4ed7-9751-4fa528dd3484 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:25.185794 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cffeb33a-2eb9-4ed7-9751-4fa528dd3484 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:25.186224 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cffeb33a-2eb9-4ed7-9751-4fa528dd3484 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:25.186898 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cffeb33a-2eb9-4ed7-9751-4fa528dd3484 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:25.187345 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cffeb33a-2eb9-4ed7-9751-4fa528dd3484 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:25.187765 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cffeb33a-2eb9-4ed7-9751-4fa528dd3484 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:25.213218 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-cffeb33a-2eb9-4ed7-9751-4fa528dd3484 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Going to try to terminate instance {{(pid=127141) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 04:42:25.287901 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-cffeb33a-2eb9-4ed7-9751-4fa528dd3484 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 204 len: 0 microversion: 2.1 time: 0.113596 Sep 25 04:42:25.288537 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 330/713] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 25 04:42:25 2022] DELETE /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 04:42:25.296879 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-4897bad8-5ce9-4abc-abdf-593f4f1006d7 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:25.297489 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-4897bad8-5ce9-4abc-abdf-593f4f1006d7 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:25.304517 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4897bad8-5ce9-4abc-abdf-593f4f1006d7 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:25.305065 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4897bad8-5ce9-4abc-abdf-593f4f1006d7 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:25.305503 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4897bad8-5ce9-4abc-abdf-593f4f1006d7 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:25.306189 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4897bad8-5ce9-4abc-abdf-593f4f1006d7 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:25.306645 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4897bad8-5ce9-4abc-abdf-593f4f1006d7 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:25.307072 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4897bad8-5ce9-4abc-abdf-593f4f1006d7 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:25.433718 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-4897bad8-5ce9-4abc-abdf-593f4f1006d7 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:25.441447 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-4897bad8-5ce9-4abc-abdf-593f4f1006d7 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1678 microversion: 2.1 time: 0.148467 Sep 25 04:42:25.442004 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 384/714] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:42:25 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:42:26.465372 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-11e5ab94-ef64-42ee-8c57-195bb7f71906 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:26.465996 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-11e5ab94-ef64-42ee-8c57-195bb7f71906 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:26.472418 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-11e5ab94-ef64-42ee-8c57-195bb7f71906 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:26.472937 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-11e5ab94-ef64-42ee-8c57-195bb7f71906 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:26.473441 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-11e5ab94-ef64-42ee-8c57-195bb7f71906 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:26.474201 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-11e5ab94-ef64-42ee-8c57-195bb7f71906 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:26.474702 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-11e5ab94-ef64-42ee-8c57-195bb7f71906 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:26.475135 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-11e5ab94-ef64-42ee-8c57-195bb7f71906 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:26.606518 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-11e5ab94-ef64-42ee-8c57-195bb7f71906 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:26.614762 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-11e5ab94-ef64-42ee-8c57-195bb7f71906 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1678 microversion: 2.1 time: 0.153482 Sep 25 04:42:26.615328 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 331/715] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:42:26 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:42:27.638621 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-5729f932-a576-4851-8e9e-1f5ae5e2447e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:27.639158 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-5729f932-a576-4851-8e9e-1f5ae5e2447e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:27.646063 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5729f932-a576-4851-8e9e-1f5ae5e2447e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:27.646553 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5729f932-a576-4851-8e9e-1f5ae5e2447e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:27.646989 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5729f932-a576-4851-8e9e-1f5ae5e2447e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:27.647676 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5729f932-a576-4851-8e9e-1f5ae5e2447e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:27.648125 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5729f932-a576-4851-8e9e-1f5ae5e2447e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:27.648552 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5729f932-a576-4851-8e9e-1f5ae5e2447e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:27.853318 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-5729f932-a576-4851-8e9e-1f5ae5e2447e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:27.861570 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-5729f932-a576-4851-8e9e-1f5ae5e2447e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1678 microversion: 2.1 time: 0.226818 Sep 25 04:42:27.862146 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 385/716] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:42:27 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1678 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:42:28.424910 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [req-a636c5a9-dea5-439d-94ca-b9fc53f1cd67 req-b950d229-bd14-414f-adde-08972c4858ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a31d3c84-7c72-4a2c-970c-b58e15f431f1", "name": "network-vif-deleted", "tag": "02bb815d-6dec-4eac-9221-50f10407403b"}]} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:42:28.437493 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-a636c5a9-dea5-439d-94ca-b9fc53f1cd67 req-b950d229-bd14-414f-adde-08972c4858ad service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:28.437970 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-a636c5a9-dea5-439d-94ca-b9fc53f1cd67 req-b950d229-bd14-414f-adde-08972c4858ad service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:28.438393 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-a636c5a9-dea5-439d-94ca-b9fc53f1cd67 req-b950d229-bd14-414f-adde-08972c4858ad service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:28.452528 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.compute.server_external_events [req-a636c5a9-dea5-439d-94ca-b9fc53f1cd67 req-b950d229-bd14-414f-adde-08972c4858ad service nova] Creating event network-vif-deleted:02bb815d-6dec-4eac-9221-50f10407403b for instance a31d3c84-7c72-4a2c-970c-b58e15f431f1 on hv-cinder-85535 Sep 25 04:42:28.460056 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [req-a636c5a9-dea5-439d-94ca-b9fc53f1cd67 req-b950d229-bd14-414f-adde-08972c4858ad service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039075 Sep 25 04:42:28.460676 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 332/717] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:42:28.885862 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-9894c87f-f466-4b76-ab1f-3d4fb8d33b4c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:28.886481 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-9894c87f-f466-4b76-ab1f-3d4fb8d33b4c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:28.893013 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9894c87f-f466-4b76-ab1f-3d4fb8d33b4c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:28.893508 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9894c87f-f466-4b76-ab1f-3d4fb8d33b4c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:28.893947 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9894c87f-f466-4b76-ab1f-3d4fb8d33b4c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:28.894647 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9894c87f-f466-4b76-ab1f-3d4fb8d33b4c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:28.895102 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9894c87f-f466-4b76-ab1f-3d4fb8d33b4c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:28.895695 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9894c87f-f466-4b76-ab1f-3d4fb8d33b4c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:28.928116 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9894c87f-f466-4b76-ab1f-3d4fb8d33b4c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:28.928598 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9894c87f-f466-4b76-ab1f-3d4fb8d33b4c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:28.929068 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9894c87f-f466-4b76-ab1f-3d4fb8d33b4c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:28.929526 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.objects.instance [None req-9894c87f-f466-4b76-ab1f-3d4fb8d33b4c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lazy-loading 'fault' on Instance uuid a31d3c84-7c72-4a2c-970c-b58e15f431f1 {{(pid=127142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 04:42:28.970007 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-9894c87f-f466-4b76-ab1f-3d4fb8d33b4c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:28.978385 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-9894c87f-f466-4b76-ab1f-3d4fb8d33b4c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 200 len: 1330 microversion: 2.1 time: 0.096414 Sep 25 04:42:28.978956 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 386/718] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:42:28 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 1330 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:42:30.003017 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-0b08483f-7f7f-4dcb-b013-665e8bb30ed6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:30.003748 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-0b08483f-7f7f-4dcb-b013-665e8bb30ed6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:30.010996 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0b08483f-7f7f-4dcb-b013-665e8bb30ed6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:30.011478 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0b08483f-7f7f-4dcb-b013-665e8bb30ed6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:30.011913 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0b08483f-7f7f-4dcb-b013-665e8bb30ed6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:30.012603 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0b08483f-7f7f-4dcb-b013-665e8bb30ed6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:30.013079 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0b08483f-7f7f-4dcb-b013-665e8bb30ed6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:30.013508 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0b08483f-7f7f-4dcb-b013-665e8bb30ed6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:30.027694 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.wsgi [None req-0b08483f-7f7f-4dcb-b013-665e8bb30ed6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] HTTP exception thrown: Instance a31d3c84-7c72-4a2c-970c-b58e15f431f1 could not be found. Sep 25 04:42:30.029438 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-0b08483f-7f7f-4dcb-b013-665e8bb30ed6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Request method failure captured: Sep 25 04:42:30.029438 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: request: GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 HTTP/1.1 Sep 25 04:42:30.029438 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept: application/json Sep 25 04:42:30.029438 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept-Encoding: identity Sep 25 04:42:30.029438 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Connection: close Sep 25 04:42:30.029438 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Length: 0 Sep 25 04:42:30.029438 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Type: application/json Sep 25 04:42:30.029438 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Host: 10.222.0.25 Sep 25 04:42:30.029438 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Openstack-System-Scope: None Sep 25 04:42:30.029438 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: User-Agent: python-urllib3/1.26.12 Sep 25 04:42:30.029438 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Auth-Token: gAAAAABjL9qrZElSae56-vG92SlYq1mROXWpWxGFTOD54wjMJs5cfOlxoWE8oAX6RsHfzZAezv5xiCHlYRD_dbdLKAb4-UUsE_8Gy0JkuMwbWForQ70ZIoDPfES94_73P9FeYeuBsh7sfePpFsox-IWSco1U62FJ77nXfz6wXdXOU1pyUSzZLWo Sep 25 04:42:30.029438 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Id: None Sep 25 04:42:30.029438 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Name: None Sep 25 04:42:30.029438 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Identity-Status: Confirmed Sep 25 04:42:30.029438 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Is-Admin-Project: True Sep 25 04:42:30.029438 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Id: default Sep 25 04:42:30.029438 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Name: Default Sep 25 04:42:30.029438 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Id: 5ead2221f7f54d6cbea9fc086a089342 Sep 25 04:42:30.029438 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Name: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:42:30.029438 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Role: reader,member Sep 25 04:42:30.029438 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Roles: reader,member Sep 25 04:42:30.031049 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5ead2221f7f54d6cbea9fc086a089342"}]}] Sep 25 04:42:30.031049 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:42:30.031049 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Id: 5ead2221f7f54d6cbea9fc086a089342 Sep 25 04:42:30.031049 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:42:30.031049 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User: tempest-AttachVolumeNegativeTest-1212083561-project Sep 25 04:42:30.031049 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Id: default Sep 25 04:42:30.031049 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Name: Default Sep 25 04:42:30.031049 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Id: c50ba6f9a164463eae9a248936e7bf80 Sep 25 04:42:30.031049 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Name: tempest-AttachVolumeNegativeTest-1212083561-project Sep 25 04:42:30.031049 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: method: > Sep 25 04:42:30.031049 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: exception: Instance a31d3c84-7c72-4a2c-970c-b58e15f431f1 could not be found. Sep 25 04:42:30.031049 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: action_args: {'id': 'a31d3c84-7c72-4a2c-970c-b58e15f431f1'} Sep 25 04:42:30.031988 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:42:30.031988 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:42:30.031988 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:42:30.031988 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:42:30.031988 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:42:30.031988 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:42:30.031988 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:42:30.031988 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:42:30.031988 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:42:30.031988 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:42:30.031988 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a31d3c84-7c72-4a2c-970c-b58e15f431f1 could not be found. Sep 25 04:42:30.031988 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:42:30.031988 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:42:30.031988 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:42:30.031988 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:42:30.031988 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:42:30.031988 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:42:30.031988 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:42:30.031988 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:42:30.031988 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:42:30.033297 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:42:30.033297 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 04:42:30.033297 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 04:42:30.033297 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:42:30.033297 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:42:30.033297 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:42:30.033297 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:42:30.033297 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a31d3c84-7c72-4a2c-970c-b58e15f431f1 could not be found. Sep 25 04:42:30.033297 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:42:30.033297 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:42:30.033297 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:42:30.033297 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:42:30.033297 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:42:30.033297 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:42:30.033297 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:42:30.033297 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:42:30.033297 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a31d3c84-7c72-4a2c-970c-b58e15f431f1 could not be found. Sep 25 04:42:30.033297 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:42:30.034421 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-0b08483f-7f7f-4dcb-b013-665e8bb30ed6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Returning 404 to user: Instance a31d3c84-7c72-4a2c-970c-b58e15f431f1 could not be found. {{(pid=127141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:42:30.034421 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-0b08483f-7f7f-4dcb-b013-665e8bb30ed6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 404 len: 111 microversion: 2.1 time: 0.032101 Sep 25 04:42:30.034421 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 333/719] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:42:29 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 04:42:30.039769 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-2476e81f-f955-4899-8cea-ba178b470015 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '.version_select at 0x7f4d3ebb7700>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:30.059678 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-2476e81f-f955-4899-8cea-ba178b470015 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-38398811" status: 202 len: 0 microversion: 2.1 time: 0.023840 Sep 25 04:42:30.060221 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 387/720] 10.222.0.25 () {58 vars in 1215 bytes} [Sun Sep 25 04:42:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-38398811 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 04:42:30.680180 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-958a804e-6f40-4c5e-9ba7-8e94d0277e2d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Action: 'create', calling method: .version_select at 0x7f4d3ec5c700>, body: {"keypair": {"name": "tempest-keypair-1522292259", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO02vVTHJSsb5deRW04eEB9vjTXuBKXFDCrgan8Oydz+7EKqMLg/geQT+ohsa6l3XuAUblwmCnD3Njx0k1LqCjgtvuXt8S2UYW46TrcUOlSZiL+3Jikx/prCCq+VQsaiJg=="}} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:42:30.695467 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.quota [None req-958a804e-6f40-4c5e-9ba7-8e94d0277e2d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Getting quotas for project 5ead2221f7f54d6cbea9fc086a089342. Resources: {'key_pairs'} {{(pid=127141) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 04:42:30.699212 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.quota [None req-958a804e-6f40-4c5e-9ba7-8e94d0277e2d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Getting quotas for user c50ba6f9a164463eae9a248936e7bf80 and project 5ead2221f7f54d6cbea9fc086a089342. Resources: {'key_pairs'} {{(pid=127141) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 04:42:30.711113 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR oslo.messaging._drivers.impl_rabbit [None req-958a804e-6f40-4c5e-9ba7-8e94d0277e2d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [b2207077-1aa0-4730-9cfa-ac2e1dc15f61] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 25 04:42:31.718530 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO oslo.messaging._drivers.impl_rabbit [None req-958a804e-6f40-4c5e-9ba7-8e94d0277e2d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [b2207077-1aa0-4730-9cfa-ac2e1dc15f61] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 40182. Sep 25 04:42:31.732502 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-958a804e-6f40-4c5e-9ba7-8e94d0277e2d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.056711 Sep 25 04:42:31.733068 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 334/721] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 25 04:42:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:42:33.150772 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-d157e153-0962-4f16-841f-aac5f9a96570 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1064091965", "imageRef": "e5cfdbb2-d0ce-4736-b311-1a3c155844e9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4d931b43-9f4d-4494-b9d1-d242cc1f110c"}], "security_groups": [{"name": "tempest-securitygroup--1235119671"}], "key_name": "tempest-keypair-1522292259", "user_data": "}} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:42:33.253143 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.network.neutron [None req-d157e153-0962-4f16-841f-aac5f9a96570 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] validate_networks() for [('4d931b43-9f4d-4494-b9d1-d242cc1f110c', None, None, None, None, None)] {{(pid=127142) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 04:42:33.616558 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-d157e153-0962-4f16-841f-aac5f9a96570 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Flavor limits 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 04:42:33.617028 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-d157e153-0962-4f16-841f-aac5f9a96570 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Image limits 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 04:42:33.617546 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-d157e153-0962-4f16-841f-aac5f9a96570 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Flavor pref 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 04:42:33.617958 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-d157e153-0962-4f16-841f-aac5f9a96570 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Image pref 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 04:42:33.618373 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-d157e153-0962-4f16-841f-aac5f9a96570 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 04:42:33.627101 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d157e153-0962-4f16-841f-aac5f9a96570 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:33.627589 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d157e153-0962-4f16-841f-aac5f9a96570 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:33.628028 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d157e153-0962-4f16-841f-aac5f9a96570 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:33.628790 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d157e153-0962-4f16-841f-aac5f9a96570 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:33.629250 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d157e153-0962-4f16-841f-aac5f9a96570 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:33.629699 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d157e153-0962-4f16-841f-aac5f9a96570 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:33.646411 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.quota [None req-d157e153-0962-4f16-841f-aac5f9a96570 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Getting quotas for project 5ead2221f7f54d6cbea9fc086a089342. Resources: {'instances', 'ram', 'cores'} {{(pid=127142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 04:42:33.650394 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.quota [None req-d157e153-0962-4f16-841f-aac5f9a96570 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Getting quotas for user c50ba6f9a164463eae9a248936e7bf80 and project 5ead2221f7f54d6cbea9fc086a089342. Resources: {'instances', 'ram', 'cores'} {{(pid=127142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 04:42:33.661870 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-d157e153-0962-4f16-841f-aac5f9a96570 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Going to run 1 instances... {{(pid=127142) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 04:42:33.664156 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-d157e153-0962-4f16-841f-aac5f9a96570 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 3170bd2b-77a7-44d5-b7ae-c4352013e7c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5cfdbb2-d0ce-4736-b311-1a3c155844e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 04:42:33.710397 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-d157e153-0962-4f16-841f-aac5f9a96570 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.564739 Sep 25 04:42:33.712813 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 388/722] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 25 04:42:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 04:42:33.722950 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-21667e0d-59ef-4cbd-a994-2ddce9d53adc tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:33.724232 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-21667e0d-59ef-4cbd-a994-2ddce9d53adc tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 3170bd2b-77a7-44d5-b7ae-c4352013e7c9] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:33.782930 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-21667e0d-59ef-4cbd-a994-2ddce9d53adc tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:33.791127 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-21667e0d-59ef-4cbd-a994-2ddce9d53adc tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9" status: 200 len: 1242 microversion: 2.1 time: 0.072529 Sep 25 04:42:33.791685 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 335/723] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:42:33 2022] GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9 => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:42:34.815017 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-8308317b-b7c1-4c44-8196-94f049d39621 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:34.815632 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-8308317b-b7c1-4c44-8196-94f049d39621 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 3170bd2b-77a7-44d5-b7ae-c4352013e7c9] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:34.822445 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8308317b-b7c1-4c44-8196-94f049d39621 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:34.822928 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8308317b-b7c1-4c44-8196-94f049d39621 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:34.823364 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8308317b-b7c1-4c44-8196-94f049d39621 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:34.824049 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8308317b-b7c1-4c44-8196-94f049d39621 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:34.824504 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8308317b-b7c1-4c44-8196-94f049d39621 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:34.824972 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8308317b-b7c1-4c44-8196-94f049d39621 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:34.887451 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-8308317b-b7c1-4c44-8196-94f049d39621 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:34.895729 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-8308317b-b7c1-4c44-8196-94f049d39621 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9" status: 200 len: 1294 microversion: 2.1 time: 0.084593 Sep 25 04:42:34.896290 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 389/724] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:42:34 2022] GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9 => generated 1294 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:42:35.919359 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-7749497b-de7c-4aeb-9ac6-321308ae5f8a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:35.920614 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-7749497b-de7c-4aeb-9ac6-321308ae5f8a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 3170bd2b-77a7-44d5-b7ae-c4352013e7c9] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:35.927952 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7749497b-de7c-4aeb-9ac6-321308ae5f8a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:35.928552 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7749497b-de7c-4aeb-9ac6-321308ae5f8a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:35.929086 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7749497b-de7c-4aeb-9ac6-321308ae5f8a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:35.929860 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7749497b-de7c-4aeb-9ac6-321308ae5f8a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:35.930379 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7749497b-de7c-4aeb-9ac6-321308ae5f8a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:35.930867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7749497b-de7c-4aeb-9ac6-321308ae5f8a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:36.182759 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-7749497b-de7c-4aeb-9ac6-321308ae5f8a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:36.190295 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-7749497b-de7c-4aeb-9ac6-321308ae5f8a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9" status: 200 len: 1368 microversion: 2.1 time: 0.274877 Sep 25 04:42:36.190853 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 336/725] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:42:35 2022] GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9 => generated 1368 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:42:36.600190 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-0fb7e180-39cd-44ec-b757-8271e7371c3d req-a73db848-4965-4662-a9d8-7bedd116d903 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3170bd2b-77a7-44d5-b7ae-c4352013e7c9", "tag": "aa510891-580c-4ef4-bb76-929629ee9d1d"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:42:36.613256 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-0fb7e180-39cd-44ec-b757-8271e7371c3d req-a73db848-4965-4662-a9d8-7bedd116d903 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:36.614442 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-0fb7e180-39cd-44ec-b757-8271e7371c3d req-a73db848-4965-4662-a9d8-7bedd116d903 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:36.615593 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-0fb7e180-39cd-44ec-b757-8271e7371c3d req-a73db848-4965-4662-a9d8-7bedd116d903 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:36.628448 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-0fb7e180-39cd-44ec-b757-8271e7371c3d req-a73db848-4965-4662-a9d8-7bedd116d903 service nova] Creating event network-changed:aa510891-580c-4ef4-bb76-929629ee9d1d for instance 3170bd2b-77a7-44d5-b7ae-c4352013e7c9 on hv-cinder-85535 Sep 25 04:42:36.633739 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-0fb7e180-39cd-44ec-b757-8271e7371c3d req-a73db848-4965-4662-a9d8-7bedd116d903 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039905 Sep 25 04:42:36.634325 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 390/726] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:42:37.215190 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-0fcad189-2f4d-48fa-bdbc-9ba1dd9002bd tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:37.215981 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-0fcad189-2f4d-48fa-bdbc-9ba1dd9002bd tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 3170bd2b-77a7-44d5-b7ae-c4352013e7c9] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:37.224282 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0fcad189-2f4d-48fa-bdbc-9ba1dd9002bd tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:37.224802 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0fcad189-2f4d-48fa-bdbc-9ba1dd9002bd tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:37.225245 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0fcad189-2f4d-48fa-bdbc-9ba1dd9002bd tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:37.225944 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0fcad189-2f4d-48fa-bdbc-9ba1dd9002bd tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:37.226413 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0fcad189-2f4d-48fa-bdbc-9ba1dd9002bd tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:37.226834 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0fcad189-2f4d-48fa-bdbc-9ba1dd9002bd tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:37.353490 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-0fcad189-2f4d-48fa-bdbc-9ba1dd9002bd tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:37.361005 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-0fcad189-2f4d-48fa-bdbc-9ba1dd9002bd tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9" status: 200 len: 1368 microversion: 2.1 time: 0.150281 Sep 25 04:42:37.361574 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 337/727] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:42:37 2022] GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:42:38.265539 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-da1820e7-8583-4d36-9d68-c1d9b02fc35f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:38.266119 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-da1820e7-8583-4d36-9d68-c1d9b02fc35f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:38.272848 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-da1820e7-8583-4d36-9d68-c1d9b02fc35f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:38.273329 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-da1820e7-8583-4d36-9d68-c1d9b02fc35f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:38.273763 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-da1820e7-8583-4d36-9d68-c1d9b02fc35f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:38.274445 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-da1820e7-8583-4d36-9d68-c1d9b02fc35f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:38.274892 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-da1820e7-8583-4d36-9d68-c1d9b02fc35f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:38.275318 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-da1820e7-8583-4d36-9d68-c1d9b02fc35f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:38.354439 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.objects.instance [None req-da1820e7-8583-4d36-9d68-c1d9b02fc35f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lazy-loading 'services' on Instance uuid 1348d173-f0db-4d60-94f5-1765387d7294 {{(pid=127142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 04:42:38.384510 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-ae83473c-1eee-4684-b954-c4846c77bb20 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:38.385150 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-ae83473c-1eee-4684-b954-c4846c77bb20 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 3170bd2b-77a7-44d5-b7ae-c4352013e7c9] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:38.391368 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ae83473c-1eee-4684-b954-c4846c77bb20 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:38.391845 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ae83473c-1eee-4684-b954-c4846c77bb20 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:38.392276 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ae83473c-1eee-4684-b954-c4846c77bb20 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:38.393127 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ae83473c-1eee-4684-b954-c4846c77bb20 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:38.393542 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ae83473c-1eee-4684-b954-c4846c77bb20 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:38.393966 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ae83473c-1eee-4684-b954-c4846c77bb20 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:38.427761 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-da1820e7-8583-4d36-9d68-c1d9b02fc35f tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294/os-volume_attachments/8782e967-ac59-4743-9b18-ab2a004d6ab8" status: 202 len: 0 microversion: 2.1 time: 0.166810 Sep 25 04:42:38.428350 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 391/728] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Sep 25 04:42:38 2022] DELETE /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294/os-volume_attachments/8782e967-ac59-4743-9b18-ab2a004d6ab8 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 04:42:38.436777 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-89805426-ab07-4196-acb5-7b486325aaf6 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:38.439054 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-89805426-ab07-4196-acb5-7b486325aaf6 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:38.445797 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-89805426-ab07-4196-acb5-7b486325aaf6 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:38.446295 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-89805426-ab07-4196-acb5-7b486325aaf6 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:38.446714 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-89805426-ab07-4196-acb5-7b486325aaf6 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:38.447402 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-89805426-ab07-4196-acb5-7b486325aaf6 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:38.447853 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-89805426-ab07-4196-acb5-7b486325aaf6 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:38.448274 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-89805426-ab07-4196-acb5-7b486325aaf6 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:38.482061 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-89805426-ab07-4196-acb5-7b486325aaf6 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049275 Sep 25 04:42:38.482629 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 392/729] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 25 04:42:38 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 04:42:38.524266 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-ae83473c-1eee-4684-b954-c4846c77bb20 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:38.531939 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-ae83473c-1eee-4684-b954-c4846c77bb20 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9" status: 200 len: 1368 microversion: 2.1 time: 0.151165 Sep 25 04:42:38.532492 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 338/730] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:42:38 2022] GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:42:39.494760 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-48a09dae-241c-479e-a49d-e527752aac5e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:39.496896 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-48a09dae-241c-479e-a49d-e527752aac5e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:39.503314 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-48a09dae-241c-479e-a49d-e527752aac5e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:39.503792 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-48a09dae-241c-479e-a49d-e527752aac5e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:39.504224 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-48a09dae-241c-479e-a49d-e527752aac5e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:39.505601 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-48a09dae-241c-479e-a49d-e527752aac5e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:39.506051 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-48a09dae-241c-479e-a49d-e527752aac5e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:39.506469 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-48a09dae-241c-479e-a49d-e527752aac5e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:39.535507 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-48a09dae-241c-479e-a49d-e527752aac5e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044690 Sep 25 04:42:39.536158 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 393/731] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 25 04:42:39 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:42:39.554803 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-fc97dcfb-c16e-4cd6-bfb4-d9870ec4b7e4 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:39.555413 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-fc97dcfb-c16e-4cd6-bfb4-d9870ec4b7e4 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 3170bd2b-77a7-44d5-b7ae-c4352013e7c9] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:39.562167 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fc97dcfb-c16e-4cd6-bfb4-d9870ec4b7e4 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:39.562659 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fc97dcfb-c16e-4cd6-bfb4-d9870ec4b7e4 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:39.563097 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fc97dcfb-c16e-4cd6-bfb4-d9870ec4b7e4 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:39.563794 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fc97dcfb-c16e-4cd6-bfb4-d9870ec4b7e4 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:39.564254 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fc97dcfb-c16e-4cd6-bfb4-d9870ec4b7e4 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:39.564707 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fc97dcfb-c16e-4cd6-bfb4-d9870ec4b7e4 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:39.698527 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-fc97dcfb-c16e-4cd6-bfb4-d9870ec4b7e4 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:39.706163 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-fc97dcfb-c16e-4cd6-bfb4-d9870ec4b7e4 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9" status: 200 len: 1368 microversion: 2.1 time: 0.155363 Sep 25 04:42:39.706726 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 339/732] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:42:39 2022] GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:42:40.548050 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-3a7d86a8-9aeb-41b2-aa9a-b6d0cde68605 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:40.550186 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-3a7d86a8-9aeb-41b2-aa9a-b6d0cde68605 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:40.557661 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3a7d86a8-9aeb-41b2-aa9a-b6d0cde68605 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:40.558134 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3a7d86a8-9aeb-41b2-aa9a-b6d0cde68605 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:40.558564 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3a7d86a8-9aeb-41b2-aa9a-b6d0cde68605 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:40.559244 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3a7d86a8-9aeb-41b2-aa9a-b6d0cde68605 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:40.559691 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3a7d86a8-9aeb-41b2-aa9a-b6d0cde68605 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:40.560110 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3a7d86a8-9aeb-41b2-aa9a-b6d0cde68605 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:40.589375 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-3a7d86a8-9aeb-41b2-aa9a-b6d0cde68605 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045218 Sep 25 04:42:40.589910 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 394/733] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 25 04:42:40 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:42:40.729185 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-b4023352-5edb-4faf-936d-bd2f05bad2ff tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:40.729911 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-b4023352-5edb-4faf-936d-bd2f05bad2ff tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 3170bd2b-77a7-44d5-b7ae-c4352013e7c9] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:40.736841 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b4023352-5edb-4faf-936d-bd2f05bad2ff tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:40.737256 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b4023352-5edb-4faf-936d-bd2f05bad2ff tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:40.737888 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b4023352-5edb-4faf-936d-bd2f05bad2ff tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:40.738598 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b4023352-5edb-4faf-936d-bd2f05bad2ff tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:40.739760 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b4023352-5edb-4faf-936d-bd2f05bad2ff tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:40.740500 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b4023352-5edb-4faf-936d-bd2f05bad2ff tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:40.760926 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:42:40.955243 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-b4023352-5edb-4faf-936d-bd2f05bad2ff tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:40.963338 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-b4023352-5edb-4faf-936d-bd2f05bad2ff tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9" status: 200 len: 1368 microversion: 2.1 time: 0.238032 Sep 25 04:42:40.963906 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 340/734] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:42:40 2022] GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9 => generated 1368 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:42:41.602392 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-4892fb42-7c90-4f79-8a13-8d1c3b40cd69 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:41.604673 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-4892fb42-7c90-4f79-8a13-8d1c3b40cd69 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:41.611203 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4892fb42-7c90-4f79-8a13-8d1c3b40cd69 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:41.611717 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4892fb42-7c90-4f79-8a13-8d1c3b40cd69 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:41.612153 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4892fb42-7c90-4f79-8a13-8d1c3b40cd69 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:41.612873 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4892fb42-7c90-4f79-8a13-8d1c3b40cd69 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:41.613355 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4892fb42-7c90-4f79-8a13-8d1c3b40cd69 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:41.613858 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4892fb42-7c90-4f79-8a13-8d1c3b40cd69 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:41.630692 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:42:41.644823 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-4892fb42-7c90-4f79-8a13-8d1c3b40cd69 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046856 Sep 25 04:42:41.646320 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 395/735] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 25 04:42:41 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:42:41.993849 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-e2ed06e8-2ec5-4d84-9c3c-a541580db60a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:41.994561 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-e2ed06e8-2ec5-4d84-9c3c-a541580db60a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 3170bd2b-77a7-44d5-b7ae-c4352013e7c9] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:42.001070 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e2ed06e8-2ec5-4d84-9c3c-a541580db60a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:42.001556 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e2ed06e8-2ec5-4d84-9c3c-a541580db60a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:42.001990 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e2ed06e8-2ec5-4d84-9c3c-a541580db60a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:42.002689 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e2ed06e8-2ec5-4d84-9c3c-a541580db60a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:42.003143 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e2ed06e8-2ec5-4d84-9c3c-a541580db60a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:42.003574 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e2ed06e8-2ec5-4d84-9c3c-a541580db60a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:42.135010 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-e2ed06e8-2ec5-4d84-9c3c-a541580db60a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:42.142720 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-e2ed06e8-2ec5-4d84-9c3c-a541580db60a tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9" status: 200 len: 1368 microversion: 2.1 time: 0.159998 Sep 25 04:42:42.143289 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 341/736] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:42:41 2022] GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:42:42.153343 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-bc5e3a9b-ac98-4244-a9fb-d7cde38381a5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:42.153844 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-bc5e3a9b-ac98-4244-a9fb-d7cde38381a5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:42.159718 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bc5e3a9b-ac98-4244-a9fb-d7cde38381a5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:42.160205 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bc5e3a9b-ac98-4244-a9fb-d7cde38381a5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:42.160822 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bc5e3a9b-ac98-4244-a9fb-d7cde38381a5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:42.161521 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bc5e3a9b-ac98-4244-a9fb-d7cde38381a5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:42.161976 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bc5e3a9b-ac98-4244-a9fb-d7cde38381a5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:42.162431 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bc5e3a9b-ac98-4244-a9fb-d7cde38381a5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:42.191348 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-bc5e3a9b-ac98-4244-a9fb-d7cde38381a5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14/os-volume_attachments/d23d85f2-86e3-4a50-8cf7-fda618bf290b" status: 200 len: 194 microversion: 2.20 time: 0.041981 Sep 25 04:42:42.192711 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 396/737] 10.222.0.25 () {60 vars in 1454 bytes} [Sun Sep 25 04:42:42 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14/os-volume_attachments/d23d85f2-86e3-4a50-8cf7-fda618bf290b => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 04:42:42.262309 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-7cde2a48-d539-445a-af8d-7cc3bb3e25f6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:42.262739 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-7cde2a48-d539-445a-af8d-7cc3bb3e25f6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:42.268613 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7cde2a48-d539-445a-af8d-7cc3bb3e25f6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:42.269128 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7cde2a48-d539-445a-af8d-7cc3bb3e25f6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:42.269570 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7cde2a48-d539-445a-af8d-7cc3bb3e25f6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:42.270325 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7cde2a48-d539-445a-af8d-7cc3bb3e25f6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:42.270783 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7cde2a48-d539-445a-af8d-7cc3bb3e25f6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:42.271213 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7cde2a48-d539-445a-af8d-7cc3bb3e25f6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:42.352421 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.objects.instance [None req-7cde2a48-d539-445a-af8d-7cc3bb3e25f6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lazy-loading 'services' on Instance uuid c9e99419-ae76-4d84-9e7a-d0a31530ea14 {{(pid=127141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 04:42:42.421893 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-7cde2a48-d539-445a-af8d-7cc3bb3e25f6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14/os-volume_attachments/d23d85f2-86e3-4a50-8cf7-fda618bf290b" status: 202 len: 0 microversion: 2.20 time: 0.163397 Sep 25 04:42:42.422712 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 342/738] 10.222.0.25 () {60 vars in 1457 bytes} [Sun Sep 25 04:42:42 2022] DELETE /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14/os-volume_attachments/d23d85f2-86e3-4a50-8cf7-fda618bf290b => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 25 04:42:42.432108 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-414f2b17-85cc-4a0e-a419-a167a290c2ed tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:42.434269 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-414f2b17-85cc-4a0e-a419-a167a290c2ed tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:42.440263 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-414f2b17-85cc-4a0e-a419-a167a290c2ed tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:42.440788 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-414f2b17-85cc-4a0e-a419-a167a290c2ed tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:42.441217 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-414f2b17-85cc-4a0e-a419-a167a290c2ed tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:42.441934 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-414f2b17-85cc-4a0e-a419-a167a290c2ed tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:42.442695 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-414f2b17-85cc-4a0e-a419-a167a290c2ed tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:42.443123 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-414f2b17-85cc-4a0e-a419-a167a290c2ed tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:42.473694 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-414f2b17-85cc-4a0e-a419-a167a290c2ed tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044931 Sep 25 04:42:42.474653 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 397/739] 10.222.0.25 () {60 vars in 1343 bytes} [Sun Sep 25 04:42:42 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 04:42:42.658450 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-850adf47-ec73-43ce-8412-9273dfa37b1c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:42.661338 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-850adf47-ec73-43ce-8412-9273dfa37b1c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:42.667660 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-850adf47-ec73-43ce-8412-9273dfa37b1c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:42.668148 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-850adf47-ec73-43ce-8412-9273dfa37b1c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:42.668591 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-850adf47-ec73-43ce-8412-9273dfa37b1c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:42.669422 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-850adf47-ec73-43ce-8412-9273dfa37b1c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:42.669880 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-850adf47-ec73-43ce-8412-9273dfa37b1c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:42.670310 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-850adf47-ec73-43ce-8412-9273dfa37b1c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:42.699703 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-850adf47-ec73-43ce-8412-9273dfa37b1c tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045520 Sep 25 04:42:42.700273 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 343/740] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 25 04:42:42 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 04:42:42.781167 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-cb9f606a-a5c3-437e-b0f2-bcf135d7aa28 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:42.781679 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-cb9f606a-a5c3-437e-b0f2-bcf135d7aa28 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:42.788738 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cb9f606a-a5c3-437e-b0f2-bcf135d7aa28 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:42.789232 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cb9f606a-a5c3-437e-b0f2-bcf135d7aa28 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:42.789677 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cb9f606a-a5c3-437e-b0f2-bcf135d7aa28 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:42.790374 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cb9f606a-a5c3-437e-b0f2-bcf135d7aa28 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:42.790863 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cb9f606a-a5c3-437e-b0f2-bcf135d7aa28 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:42.791297 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cb9f606a-a5c3-437e-b0f2-bcf135d7aa28 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:42.816460 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-cb9f606a-a5c3-437e-b0f2-bcf135d7aa28 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Going to try to terminate instance {{(pid=127142) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 04:42:42.894360 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-cb9f606a-a5c3-437e-b0f2-bcf135d7aa28 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 204 len: 0 microversion: 2.1 time: 0.116884 Sep 25 04:42:42.895528 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 398/741] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 25 04:42:42 2022] DELETE /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 04:42:42.903764 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-ce3f02ef-acb5-46da-9354-a5077551cf04 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:42.904367 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-ce3f02ef-acb5-46da-9354-a5077551cf04 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:42.910232 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ce3f02ef-acb5-46da-9354-a5077551cf04 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:42.911829 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ce3f02ef-acb5-46da-9354-a5077551cf04 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:42.912272 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ce3f02ef-acb5-46da-9354-a5077551cf04 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:42.913186 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ce3f02ef-acb5-46da-9354-a5077551cf04 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:42.913638 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ce3f02ef-acb5-46da-9354-a5077551cf04 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:42.914061 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ce3f02ef-acb5-46da-9354-a5077551cf04 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:43.045859 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-ce3f02ef-acb5-46da-9354-a5077551cf04 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:43.053811 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-ce3f02ef-acb5-46da-9354-a5077551cf04 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1688 microversion: 2.1 time: 0.154055 Sep 25 04:42:43.054382 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 344/742] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:42:42 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:42:43.165877 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-94d061d4-ae8b-4caf-99b8-afa3211b1a9b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:43.166597 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-94d061d4-ae8b-4caf-99b8-afa3211b1a9b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 3170bd2b-77a7-44d5-b7ae-c4352013e7c9] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:43.172531 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-94d061d4-ae8b-4caf-99b8-afa3211b1a9b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:43.173045 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-94d061d4-ae8b-4caf-99b8-afa3211b1a9b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:43.173471 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-94d061d4-ae8b-4caf-99b8-afa3211b1a9b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:43.174146 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-94d061d4-ae8b-4caf-99b8-afa3211b1a9b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:43.174594 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-94d061d4-ae8b-4caf-99b8-afa3211b1a9b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:43.175012 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-94d061d4-ae8b-4caf-99b8-afa3211b1a9b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:43.305389 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-94d061d4-ae8b-4caf-99b8-afa3211b1a9b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:43.313028 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-94d061d4-ae8b-4caf-99b8-afa3211b1a9b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9" status: 200 len: 1368 microversion: 2.1 time: 0.152279 Sep 25 04:42:43.313587 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 399/743] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:42:43 2022] GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:42:43.486735 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-f2639b64-b443-4e37-a421-3ace776aa37c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:43.489678 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-f2639b64-b443-4e37-a421-3ace776aa37c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:43.495855 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f2639b64-b443-4e37-a421-3ace776aa37c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:43.496338 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f2639b64-b443-4e37-a421-3ace776aa37c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:43.496806 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f2639b64-b443-4e37-a421-3ace776aa37c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:43.497493 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f2639b64-b443-4e37-a421-3ace776aa37c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:43.497945 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f2639b64-b443-4e37-a421-3ace776aa37c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:43.498365 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f2639b64-b443-4e37-a421-3ace776aa37c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:43.528126 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-f2639b64-b443-4e37-a421-3ace776aa37c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045415 Sep 25 04:42:43.528689 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 345/744] 10.222.0.25 () {60 vars in 1343 bytes} [Sun Sep 25 04:42:43 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 04:42:44.077619 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-43cd43d1-8863-4b91-9d4b-2127fb026254 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:44.078230 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-43cd43d1-8863-4b91-9d4b-2127fb026254 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:44.080339 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell0:SELECT=2 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:42:44.081031 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell0:SELECT=6 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:42:44.088715 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-43cd43d1-8863-4b91-9d4b-2127fb026254 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:44.089204 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-43cd43d1-8863-4b91-9d4b-2127fb026254 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:44.089639 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-43cd43d1-8863-4b91-9d4b-2127fb026254 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:44.090328 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-43cd43d1-8863-4b91-9d4b-2127fb026254 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:44.090777 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-43cd43d1-8863-4b91-9d4b-2127fb026254 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:44.091199 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-43cd43d1-8863-4b91-9d4b-2127fb026254 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:44.220279 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-43cd43d1-8863-4b91-9d4b-2127fb026254 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:44.228087 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-43cd43d1-8863-4b91-9d4b-2127fb026254 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1688 microversion: 2.1 time: 0.154513 Sep 25 04:42:44.228673 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 400/745] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:42:44 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:42:44.335781 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-861f4f2c-987c-4f71-bce2-e0910cd587b7 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:44.336309 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-861f4f2c-987c-4f71-bce2-e0910cd587b7 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 3170bd2b-77a7-44d5-b7ae-c4352013e7c9] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:44.338533 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell0:SELECT=6 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:42:44.344168 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-861f4f2c-987c-4f71-bce2-e0910cd587b7 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:44.344661 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-861f4f2c-987c-4f71-bce2-e0910cd587b7 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:44.345112 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-861f4f2c-987c-4f71-bce2-e0910cd587b7 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:44.345797 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-861f4f2c-987c-4f71-bce2-e0910cd587b7 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:44.346250 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-861f4f2c-987c-4f71-bce2-e0910cd587b7 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:44.346675 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-861f4f2c-987c-4f71-bce2-e0910cd587b7 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:44.474265 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-861f4f2c-987c-4f71-bce2-e0910cd587b7 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:44.482602 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-861f4f2c-987c-4f71-bce2-e0910cd587b7 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9" status: 200 len: 1368 microversion: 2.1 time: 0.150932 Sep 25 04:42:44.483161 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 346/746] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:42:44 2022] GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:42:44.542578 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-1ec31e1a-3399-45ca-87e4-617db83ea544 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:44.544864 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-1ec31e1a-3399-45ca-87e4-617db83ea544 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:44.550715 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1ec31e1a-3399-45ca-87e4-617db83ea544 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:44.551257 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1ec31e1a-3399-45ca-87e4-617db83ea544 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:44.551969 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1ec31e1a-3399-45ca-87e4-617db83ea544 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:44.552674 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1ec31e1a-3399-45ca-87e4-617db83ea544 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:44.553132 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1ec31e1a-3399-45ca-87e4-617db83ea544 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:44.553555 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1ec31e1a-3399-45ca-87e4-617db83ea544 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:44.583546 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-1ec31e1a-3399-45ca-87e4-617db83ea544 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044882 Sep 25 04:42:44.584098 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 401/747] 10.222.0.25 () {60 vars in 1343 bytes} [Sun Sep 25 04:42:44 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 04:42:45.098464 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [req-cc405be5-5e1c-4208-925c-6407416b1b9c req-b24dc89b-fde7-4b53-ae4f-904229d7c5b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3170bd2b-77a7-44d5-b7ae-c4352013e7c9", "name": "network-vif-plugged", "status": "completed", "tag": "aa510891-580c-4ef4-bb76-929629ee9d1d"}]} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:42:45.108124 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-cc405be5-5e1c-4208-925c-6407416b1b9c req-b24dc89b-fde7-4b53-ae4f-904229d7c5b4 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:45.108709 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-cc405be5-5e1c-4208-925c-6407416b1b9c req-b24dc89b-fde7-4b53-ae4f-904229d7c5b4 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:45.109034 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-cc405be5-5e1c-4208-925c-6407416b1b9c req-b24dc89b-fde7-4b53-ae4f-904229d7c5b4 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:45.121361 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.compute.server_external_events [req-cc405be5-5e1c-4208-925c-6407416b1b9c req-b24dc89b-fde7-4b53-ae4f-904229d7c5b4 service nova] Creating event network-vif-plugged:aa510891-580c-4ef4-bb76-929629ee9d1d for instance 3170bd2b-77a7-44d5-b7ae-c4352013e7c9 on hv-cinder-85535 Sep 25 04:42:45.126663 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [req-cc405be5-5e1c-4208-925c-6407416b1b9c req-b24dc89b-fde7-4b53-ae4f-904229d7c5b4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032153 Sep 25 04:42:45.127247 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 347/748] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 04:42:45.250886 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-bc3e59c7-d95c-4ef0-a396-004391cea14d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:45.251430 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-bc3e59c7-d95c-4ef0-a396-004391cea14d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:45.257927 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bc3e59c7-d95c-4ef0-a396-004391cea14d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:45.258416 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bc3e59c7-d95c-4ef0-a396-004391cea14d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:45.258859 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bc3e59c7-d95c-4ef0-a396-004391cea14d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:45.259581 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bc3e59c7-d95c-4ef0-a396-004391cea14d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:45.260075 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bc3e59c7-d95c-4ef0-a396-004391cea14d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:45.260536 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bc3e59c7-d95c-4ef0-a396-004391cea14d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:45.387907 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-bc3e59c7-d95c-4ef0-a396-004391cea14d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:45.396673 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-bc3e59c7-d95c-4ef0-a396-004391cea14d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1688 microversion: 2.1 time: 0.149662 Sep 25 04:42:45.397226 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 402/749] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:42:45 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1688 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:42:45.507496 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-ab5edcc8-beed-40db-bfad-de53c0ce0e12 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:45.508116 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-ab5edcc8-beed-40db-bfad-de53c0ce0e12 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 3170bd2b-77a7-44d5-b7ae-c4352013e7c9] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:45.514268 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ab5edcc8-beed-40db-bfad-de53c0ce0e12 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:45.514744 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ab5edcc8-beed-40db-bfad-de53c0ce0e12 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:45.515178 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ab5edcc8-beed-40db-bfad-de53c0ce0e12 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:45.515858 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ab5edcc8-beed-40db-bfad-de53c0ce0e12 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:45.516307 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ab5edcc8-beed-40db-bfad-de53c0ce0e12 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:45.516764 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ab5edcc8-beed-40db-bfad-de53c0ce0e12 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:45.595477 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-7c365ab0-a7bf-4e26-b999-53e772c5d8d8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:45.597650 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-7c365ab0-a7bf-4e26-b999-53e772c5d8d8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:45.603937 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7c365ab0-a7bf-4e26-b999-53e772c5d8d8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:45.604396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7c365ab0-a7bf-4e26-b999-53e772c5d8d8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:45.604857 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7c365ab0-a7bf-4e26-b999-53e772c5d8d8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:45.605542 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7c365ab0-a7bf-4e26-b999-53e772c5d8d8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:45.605989 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7c365ab0-a7bf-4e26-b999-53e772c5d8d8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:45.606404 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7c365ab0-a7bf-4e26-b999-53e772c5d8d8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:45.636564 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-7c365ab0-a7bf-4e26-b999-53e772c5d8d8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045029 Sep 25 04:42:45.637156 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 403/750] 10.222.0.25 () {60 vars in 1343 bytes} [Sun Sep 25 04:42:45 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 25 04:42:45.644758 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-ab5edcc8-beed-40db-bfad-de53c0ce0e12 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:45.653264 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-ab5edcc8-beed-40db-bfad-de53c0ce0e12 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9" status: 200 len: 1368 microversion: 2.1 time: 0.151338 Sep 25 04:42:45.653830 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 348/751] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:42:45 2022] GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:42:46.420612 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-626631dd-be73-4793-ab4d-c60d14dff07b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:46.421885 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-626631dd-be73-4793-ab4d-c60d14dff07b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:46.429003 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-626631dd-be73-4793-ab4d-c60d14dff07b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:46.429485 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-626631dd-be73-4793-ab4d-c60d14dff07b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:46.429920 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-626631dd-be73-4793-ab4d-c60d14dff07b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:46.430611 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-626631dd-be73-4793-ab4d-c60d14dff07b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:46.431066 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-626631dd-be73-4793-ab4d-c60d14dff07b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:46.431489 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-626631dd-be73-4793-ab4d-c60d14dff07b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:46.559396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-626631dd-be73-4793-ab4d-c60d14dff07b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:46.567179 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-626631dd-be73-4793-ab4d-c60d14dff07b tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1688 microversion: 2.1 time: 0.150463 Sep 25 04:42:46.567864 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 404/752] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:42:46 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1688 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:42:46.650030 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-c66b8261-f09b-405e-aa42-a57a636ca872 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:46.652173 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-c66b8261-f09b-405e-aa42-a57a636ca872 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:46.658595 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c66b8261-f09b-405e-aa42-a57a636ca872 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:46.659071 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c66b8261-f09b-405e-aa42-a57a636ca872 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:46.659499 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c66b8261-f09b-405e-aa42-a57a636ca872 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:46.660181 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c66b8261-f09b-405e-aa42-a57a636ca872 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:46.661368 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c66b8261-f09b-405e-aa42-a57a636ca872 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:46.661796 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c66b8261-f09b-405e-aa42-a57a636ca872 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:46.675257 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-57f317c1-bcf3-497c-bfe9-4841fa9579e6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:46.675901 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-57f317c1-bcf3-497c-bfe9-4841fa9579e6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 3170bd2b-77a7-44d5-b7ae-c4352013e7c9] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:46.682656 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-57f317c1-bcf3-497c-bfe9-4841fa9579e6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:46.683148 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-57f317c1-bcf3-497c-bfe9-4841fa9579e6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:46.683586 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-57f317c1-bcf3-497c-bfe9-4841fa9579e6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:46.684280 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-57f317c1-bcf3-497c-bfe9-4841fa9579e6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:46.684767 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-57f317c1-bcf3-497c-bfe9-4841fa9579e6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:46.685208 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-57f317c1-bcf3-497c-bfe9-4841fa9579e6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:46.692281 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-c66b8261-f09b-405e-aa42-a57a636ca872 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047244 Sep 25 04:42:46.692900 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 349/753] 10.222.0.25 () {60 vars in 1343 bytes} [Sun Sep 25 04:42:46 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 04:42:46.813962 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-57f317c1-bcf3-497c-bfe9-4841fa9579e6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:46.821861 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-57f317c1-bcf3-497c-bfe9-4841fa9579e6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9" status: 200 len: 1368 microversion: 2.1 time: 0.150435 Sep 25 04:42:46.822595 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 405/754] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:42:46 2022] GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:42:47.591694 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-e427324c-c0b9-469a-8448-bb3253f557f3 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:47.592313 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-e427324c-c0b9-469a-8448-bb3253f557f3 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:47.594336 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:42:47.599670 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e427324c-c0b9-469a-8448-bb3253f557f3 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:47.600151 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e427324c-c0b9-469a-8448-bb3253f557f3 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:47.600590 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e427324c-c0b9-469a-8448-bb3253f557f3 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:47.601306 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e427324c-c0b9-469a-8448-bb3253f557f3 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:47.601764 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e427324c-c0b9-469a-8448-bb3253f557f3 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:47.602193 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e427324c-c0b9-469a-8448-bb3253f557f3 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:47.705388 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-2e4314d1-cde0-4d6d-9671-2f6006320d2d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:47.707868 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-2e4314d1-cde0-4d6d-9671-2f6006320d2d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:47.710374 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:42:47.715924 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2e4314d1-cde0-4d6d-9671-2f6006320d2d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:47.716418 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2e4314d1-cde0-4d6d-9671-2f6006320d2d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:47.716887 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2e4314d1-cde0-4d6d-9671-2f6006320d2d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:47.717593 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2e4314d1-cde0-4d6d-9671-2f6006320d2d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:47.718050 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2e4314d1-cde0-4d6d-9671-2f6006320d2d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:47.718480 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2e4314d1-cde0-4d6d-9671-2f6006320d2d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:47.747709 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-e427324c-c0b9-469a-8448-bb3253f557f3 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:47.753972 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-2e4314d1-cde0-4d6d-9671-2f6006320d2d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052564 Sep 25 04:42:47.754641 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 406/755] 10.222.0.25 () {60 vars in 1343 bytes} [Sun Sep 25 04:42:47 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 25 04:42:47.756109 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-e427324c-c0b9-469a-8448-bb3253f557f3 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1688 microversion: 2.1 time: 0.168226 Sep 25 04:42:47.756687 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 350/756] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:42:47 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:42:47.845302 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-5184d728-50d3-4919-974f-fdbfcb6cec97 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:47.845997 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-5184d728-50d3-4919-974f-fdbfcb6cec97 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 3170bd2b-77a7-44d5-b7ae-c4352013e7c9] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:47.852872 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5184d728-50d3-4919-974f-fdbfcb6cec97 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:47.853389 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5184d728-50d3-4919-974f-fdbfcb6cec97 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:47.853818 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5184d728-50d3-4919-974f-fdbfcb6cec97 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:47.854498 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5184d728-50d3-4919-974f-fdbfcb6cec97 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:47.854944 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5184d728-50d3-4919-974f-fdbfcb6cec97 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:47.855360 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5184d728-50d3-4919-974f-fdbfcb6cec97 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:48.100447 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-5184d728-50d3-4919-974f-fdbfcb6cec97 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:48.108480 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-5184d728-50d3-4919-974f-fdbfcb6cec97 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9" status: 200 len: 1368 microversion: 2.1 time: 0.267044 Sep 25 04:42:48.109091 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 407/757] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:42:47 2022] GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9 => generated 1368 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:42:48.767230 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-cb1517c9-da67-444d-91a9-cce0828b061e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:48.769491 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-cb1517c9-da67-444d-91a9-cce0828b061e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:48.777443 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cb1517c9-da67-444d-91a9-cce0828b061e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:48.777943 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cb1517c9-da67-444d-91a9-cce0828b061e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:48.778383 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cb1517c9-da67-444d-91a9-cce0828b061e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:48.779097 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cb1517c9-da67-444d-91a9-cce0828b061e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:48.779456 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-ce4ffdb2-5267-4c6f-bbf6-eb5734205585 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:48.779915 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cb1517c9-da67-444d-91a9-cce0828b061e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:48.780015 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-cb1517c9-da67-444d-91a9-cce0828b061e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:48.780996 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-ce4ffdb2-5267-4c6f-bbf6-eb5734205585 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:48.792907 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ce4ffdb2-5267-4c6f-bbf6-eb5734205585 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:48.793402 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ce4ffdb2-5267-4c6f-bbf6-eb5734205585 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:48.793985 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ce4ffdb2-5267-4c6f-bbf6-eb5734205585 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:48.794737 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ce4ffdb2-5267-4c6f-bbf6-eb5734205585 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:48.795190 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ce4ffdb2-5267-4c6f-bbf6-eb5734205585 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:48.796119 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ce4ffdb2-5267-4c6f-bbf6-eb5734205585 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:48.814941 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-cb1517c9-da67-444d-91a9-cce0828b061e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052008 Sep 25 04:42:48.815799 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 351/758] 10.222.0.25 () {60 vars in 1343 bytes} [Sun Sep 25 04:42:48 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:42:48.892961 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-c024177b-e614-43d3-95b1-1d90e333f76d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:48.893595 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-c024177b-e614-43d3-95b1-1d90e333f76d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:48.901491 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c024177b-e614-43d3-95b1-1d90e333f76d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:48.902352 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c024177b-e614-43d3-95b1-1d90e333f76d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:48.902894 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c024177b-e614-43d3-95b1-1d90e333f76d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:48.903736 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c024177b-e614-43d3-95b1-1d90e333f76d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:48.904976 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c024177b-e614-43d3-95b1-1d90e333f76d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:48.905592 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c024177b-e614-43d3-95b1-1d90e333f76d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:48.909620 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-ce4ffdb2-5267-4c6f-bbf6-eb5734205585 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:48.934114 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-ce4ffdb2-5267-4c6f-bbf6-eb5734205585 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1621 microversion: 2.1 time: 0.157852 Sep 25 04:42:48.934975 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 408/759] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:42:48 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1621 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:42:48.946438 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-c024177b-e614-43d3-95b1-1d90e333f76d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Going to try to terminate instance {{(pid=127141) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 04:42:49.035640 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-c024177b-e614-43d3-95b1-1d90e333f76d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 204 len: 0 microversion: 2.20 time: 0.146712 Sep 25 04:42:49.036739 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 352/760] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Sep 25 04:42:48 2022] DELETE /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 25 04:42:49.045160 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-e83ecb28-b641-4403-878f-87de954caeee tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:49.045770 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-e83ecb28-b641-4403-878f-87de954caeee tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:49.052590 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e83ecb28-b641-4403-878f-87de954caeee tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:49.053143 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e83ecb28-b641-4403-878f-87de954caeee tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:49.053585 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e83ecb28-b641-4403-878f-87de954caeee tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:49.054280 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e83ecb28-b641-4403-878f-87de954caeee tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:49.054735 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e83ecb28-b641-4403-878f-87de954caeee tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:49.055155 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e83ecb28-b641-4403-878f-87de954caeee tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:49.135619 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-e5888a0b-6497-4e43-91b4-f94cd7252c5f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:49.136560 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-e5888a0b-6497-4e43-91b4-f94cd7252c5f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 3170bd2b-77a7-44d5-b7ae-c4352013e7c9] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:49.142643 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e5888a0b-6497-4e43-91b4-f94cd7252c5f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:49.143135 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e5888a0b-6497-4e43-91b4-f94cd7252c5f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:49.143577 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e5888a0b-6497-4e43-91b4-f94cd7252c5f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:49.144270 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e5888a0b-6497-4e43-91b4-f94cd7252c5f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:49.144845 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e5888a0b-6497-4e43-91b4-f94cd7252c5f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:49.145298 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e5888a0b-6497-4e43-91b4-f94cd7252c5f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:49.332663 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-e83ecb28-b641-4403-878f-87de954caeee tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:49.346887 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-e83ecb28-b641-4403-878f-87de954caeee tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:49.349206 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-e83ecb28-b641-4403-878f-87de954caeee tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:49.351621 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-e83ecb28-b641-4403-878f-87de954caeee tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1724 microversion: 2.20 time: 0.310526 Sep 25 04:42:49.352431 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 409/761] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:42:49 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1724 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 04:42:49.368628 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-0de784bd-fdfd-41e5-bc07-33871faa0432 req-b650485e-fd97-4018-a0b5-bcac84499570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1348d173-f0db-4d60-94f5-1765387d7294", "name": "network-vif-deleted", "tag": "200b52b7-c7da-4e8b-924a-5151390b5778"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:42:49.380022 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-0de784bd-fdfd-41e5-bc07-33871faa0432 req-b650485e-fd97-4018-a0b5-bcac84499570 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:49.380887 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-0de784bd-fdfd-41e5-bc07-33871faa0432 req-b650485e-fd97-4018-a0b5-bcac84499570 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:49.382063 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-0de784bd-fdfd-41e5-bc07-33871faa0432 req-b650485e-fd97-4018-a0b5-bcac84499570 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:49.388953 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-e5888a0b-6497-4e43-91b4-f94cd7252c5f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:49.397216 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-e5888a0b-6497-4e43-91b4-f94cd7252c5f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9" status: 200 len: 1558 microversion: 2.1 time: 0.265714 Sep 25 04:42:49.398968 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 353/762] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:42:49 2022] GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9 => generated 1558 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:42:49.406608 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-0de784bd-fdfd-41e5-bc07-33871faa0432 req-b650485e-fd97-4018-a0b5-bcac84499570 service nova] Creating event network-vif-deleted:200b52b7-c7da-4e8b-924a-5151390b5778 for instance 1348d173-f0db-4d60-94f5-1765387d7294 on hv-cinder-85535 Sep 25 04:42:49.413397 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-0de784bd-fdfd-41e5-bc07-33871faa0432 req-b650485e-fd97-4018-a0b5-bcac84499570 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049314 Sep 25 04:42:49.414318 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 410/763] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:42:49.424831 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-a8a85a19-be1e-476f-ac92-4e988fb82100 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:49.425329 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-a8a85a19-be1e-476f-ac92-4e988fb82100 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 3170bd2b-77a7-44d5-b7ae-c4352013e7c9] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:49.431965 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a8a85a19-be1e-476f-ac92-4e988fb82100 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:49.432451 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a8a85a19-be1e-476f-ac92-4e988fb82100 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:49.432920 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a8a85a19-be1e-476f-ac92-4e988fb82100 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:49.433621 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a8a85a19-be1e-476f-ac92-4e988fb82100 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:49.434074 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a8a85a19-be1e-476f-ac92-4e988fb82100 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:49.434501 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a8a85a19-be1e-476f-ac92-4e988fb82100 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:49.516091 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-a8a85a19-be1e-476f-ac92-4e988fb82100 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095162 Sep 25 04:42:49.516930 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 354/764] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Sep 25 04:42:49 2022] GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:42:49.959253 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-7761b01d-5722-40c3-9236-0c9e62bc0993 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:49.960833 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-7761b01d-5722-40c3-9236-0c9e62bc0993 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:49.967832 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7761b01d-5722-40c3-9236-0c9e62bc0993 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:49.968321 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7761b01d-5722-40c3-9236-0c9e62bc0993 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:49.968785 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7761b01d-5722-40c3-9236-0c9e62bc0993 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:49.969483 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7761b01d-5722-40c3-9236-0c9e62bc0993 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:49.969934 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7761b01d-5722-40c3-9236-0c9e62bc0993 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:49.970491 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7761b01d-5722-40c3-9236-0c9e62bc0993 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:49.975864 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:42:50.038727 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-7761b01d-5722-40c3-9236-0c9e62bc0993 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:50.047801 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-7761b01d-5722-40c3-9236-0c9e62bc0993 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1621 microversion: 2.1 time: 0.093265 Sep 25 04:42:50.048490 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 411/765] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:42:49 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1621 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:42:50.377875 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-671b8d31-86e6-4427-b1fb-c393ceee2279 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:50.379309 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-671b8d31-86e6-4427-b1fb-c393ceee2279 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:50.386603 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-671b8d31-86e6-4427-b1fb-c393ceee2279 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:50.387232 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-671b8d31-86e6-4427-b1fb-c393ceee2279 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:50.387706 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-671b8d31-86e6-4427-b1fb-c393ceee2279 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:50.388511 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-671b8d31-86e6-4427-b1fb-c393ceee2279 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:50.389147 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-671b8d31-86e6-4427-b1fb-c393ceee2279 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:50.389636 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-671b8d31-86e6-4427-b1fb-c393ceee2279 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:50.565475 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-671b8d31-86e6-4427-b1fb-c393ceee2279 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:50.570244 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:42:50.578701 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-671b8d31-86e6-4427-b1fb-c393ceee2279 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:50.581462 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-671b8d31-86e6-4427-b1fb-c393ceee2279 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:50.584112 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-671b8d31-86e6-4427-b1fb-c393ceee2279 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1724 microversion: 2.20 time: 0.209073 Sep 25 04:42:50.593619 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 355/766] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:42:50 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:42:50.621124 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-7d45310c-2fe0-4084-a9b1-fa16bc78e403 req-52fe4969-ef42-4a41-b0c5-24f947bd3ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3170bd2b-77a7-44d5-b7ae-c4352013e7c9", "tag": "aa510891-580c-4ef4-bb76-929629ee9d1d"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:42:50.632401 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-7d45310c-2fe0-4084-a9b1-fa16bc78e403 req-52fe4969-ef42-4a41-b0c5-24f947bd3ed7 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:50.633183 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-7d45310c-2fe0-4084-a9b1-fa16bc78e403 req-52fe4969-ef42-4a41-b0c5-24f947bd3ed7 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:50.633621 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-7d45310c-2fe0-4084-a9b1-fa16bc78e403 req-52fe4969-ef42-4a41-b0c5-24f947bd3ed7 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:50.645331 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-7d45310c-2fe0-4084-a9b1-fa16bc78e403 req-52fe4969-ef42-4a41-b0c5-24f947bd3ed7 service nova] Creating event network-changed:aa510891-580c-4ef4-bb76-929629ee9d1d for instance 3170bd2b-77a7-44d5-b7ae-c4352013e7c9 on hv-cinder-85535 Sep 25 04:42:50.650130 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-7d45310c-2fe0-4084-a9b1-fa16bc78e403 req-52fe4969-ef42-4a41-b0c5-24f947bd3ed7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115010 Sep 25 04:42:50.650716 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 412/767] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:42:51.071065 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-86661640-3e34-47af-b1f5-43eff599dd2d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:51.071669 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-86661640-3e34-47af-b1f5-43eff599dd2d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:51.078433 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-86661640-3e34-47af-b1f5-43eff599dd2d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:51.078922 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-86661640-3e34-47af-b1f5-43eff599dd2d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:51.079876 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-86661640-3e34-47af-b1f5-43eff599dd2d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:51.091178 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-86661640-3e34-47af-b1f5-43eff599dd2d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:51.091608 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-86661640-3e34-47af-b1f5-43eff599dd2d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:51.092066 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-86661640-3e34-47af-b1f5-43eff599dd2d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:51.124945 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-86661640-3e34-47af-b1f5-43eff599dd2d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:51.125425 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-86661640-3e34-47af-b1f5-43eff599dd2d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:51.125856 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-86661640-3e34-47af-b1f5-43eff599dd2d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:51.126293 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.objects.instance [None req-86661640-3e34-47af-b1f5-43eff599dd2d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lazy-loading 'fault' on Instance uuid 1348d173-f0db-4d60-94f5-1765387d7294 {{(pid=127141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 04:42:51.190666 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-86661640-3e34-47af-b1f5-43eff599dd2d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:51.199671 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-86661640-3e34-47af-b1f5-43eff599dd2d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 200 len: 1334 microversion: 2.1 time: 0.132806 Sep 25 04:42:51.200260 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 356/768] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:42:51 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 1334 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:42:51.614643 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-a138f5e9-a803-45d0-8a12-587aa053841b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:51.615971 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-a138f5e9-a803-45d0-8a12-587aa053841b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:51.625129 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a138f5e9-a803-45d0-8a12-587aa053841b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:51.625888 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a138f5e9-a803-45d0-8a12-587aa053841b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:51.626483 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a138f5e9-a803-45d0-8a12-587aa053841b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:51.627350 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a138f5e9-a803-45d0-8a12-587aa053841b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:51.628815 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a138f5e9-a803-45d0-8a12-587aa053841b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:51.631054 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a138f5e9-a803-45d0-8a12-587aa053841b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:51.864254 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-a138f5e9-a803-45d0-8a12-587aa053841b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:51.874378 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-a138f5e9-a803-45d0-8a12-587aa053841b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:51.882455 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-a138f5e9-a803-45d0-8a12-587aa053841b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:51.885975 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-a138f5e9-a803-45d0-8a12-587aa053841b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1724 microversion: 2.20 time: 0.276978 Sep 25 04:42:51.887383 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 413/769] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:42:51 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1724 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:42:52.226158 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-60b6a6d3-05dd-41d9-bdef-1b9ababc72dd tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:52.226797 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-60b6a6d3-05dd-41d9-bdef-1b9ababc72dd tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 1348d173-f0db-4d60-94f5-1765387d7294] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:52.233439 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-60b6a6d3-05dd-41d9-bdef-1b9ababc72dd tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:52.233991 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-60b6a6d3-05dd-41d9-bdef-1b9ababc72dd tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:52.234432 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-60b6a6d3-05dd-41d9-bdef-1b9ababc72dd tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:52.235153 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-60b6a6d3-05dd-41d9-bdef-1b9ababc72dd tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:52.235611 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-60b6a6d3-05dd-41d9-bdef-1b9ababc72dd tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:52.236048 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-60b6a6d3-05dd-41d9-bdef-1b9ababc72dd tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:52.250157 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.wsgi [None req-60b6a6d3-05dd-41d9-bdef-1b9ababc72dd tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] HTTP exception thrown: Instance 1348d173-f0db-4d60-94f5-1765387d7294 could not be found. Sep 25 04:42:52.251812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-60b6a6d3-05dd-41d9-bdef-1b9ababc72dd tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Request method failure captured: Sep 25 04:42:52.251812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: request: GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 HTTP/1.1 Sep 25 04:42:52.251812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept: application/json Sep 25 04:42:52.251812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept-Encoding: identity Sep 25 04:42:52.251812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Connection: close Sep 25 04:42:52.251812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Length: 0 Sep 25 04:42:52.251812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Type: application/json Sep 25 04:42:52.251812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Host: 10.222.0.25 Sep 25 04:42:52.251812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Openstack-System-Scope: None Sep 25 04:42:52.251812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: User-Agent: python-urllib3/1.26.12 Sep 25 04:42:52.251812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Auth-Token: gAAAAABjL9qqgx9SbwmoscMIXzayDkTaHYe5OsS0R6Y7sMCrDveP0He2ve1AWmZoJjvfku9MDTwEaVSQrNi9P0Yo8NZuEWbmT7VIGNUqGQXykMqiQxqIQpHToYGErquEQDCjI-WfO-ZEE9ccXdKRhNCVIGSYzSyMRRtPFFdQShrVaJWdWp_RDEI Sep 25 04:42:52.251812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Id: None Sep 25 04:42:52.251812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Name: None Sep 25 04:42:52.251812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Identity-Status: Confirmed Sep 25 04:42:52.251812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Is-Admin-Project: True Sep 25 04:42:52.251812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Id: default Sep 25 04:42:52.251812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Name: Default Sep 25 04:42:52.251812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Id: f6f23cf0323f48069e21acf059cbd1f0 Sep 25 04:42:52.251812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1236487579 Sep 25 04:42:52.251812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Role: reader,member Sep 25 04:42:52.251812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Roles: reader,member Sep 25 04:42:52.253206 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f6f23cf0323f48069e21acf059cbd1f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6f23cf0323f48069e21acf059cbd1f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6f23cf0323f48069e21acf059cbd1f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f6f23cf0323f48069e21acf059cbd1f0"}]}] Sep 25 04:42:52.253206 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1236487579 Sep 25 04:42:52.253206 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Id: f6f23cf0323f48069e21acf059cbd1f0 Sep 25 04:42:52.253206 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1236487579 Sep 25 04:42:52.253206 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User: tempest-ServerRescueNegativeTestJSON-1236487579-project Sep 25 04:42:52.253206 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Id: default Sep 25 04:42:52.253206 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Name: Default Sep 25 04:42:52.253206 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Id: 2666d4774776498bbdbce539296e76a9 Sep 25 04:42:52.253206 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1236487579-project Sep 25 04:42:52.253206 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: method: > Sep 25 04:42:52.253206 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: exception: Instance 1348d173-f0db-4d60-94f5-1765387d7294 could not be found. Sep 25 04:42:52.253206 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: action_args: {'id': '1348d173-f0db-4d60-94f5-1765387d7294'} Sep 25 04:42:52.253971 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:42:52.253971 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:42:52.253971 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:42:52.253971 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:42:52.253971 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:42:52.253971 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:42:52.253971 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:42:52.253971 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:42:52.253971 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:42:52.253971 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:42:52.253971 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1348d173-f0db-4d60-94f5-1765387d7294 could not be found. Sep 25 04:42:52.253971 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:42:52.253971 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:42:52.253971 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:42:52.253971 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:42:52.253971 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:42:52.253971 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:42:52.253971 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:42:52.253971 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:42:52.253971 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:42:52.256122 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:42:52.256122 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 04:42:52.256122 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 04:42:52.256122 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:42:52.256122 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:42:52.256122 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:42:52.256122 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:42:52.256122 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1348d173-f0db-4d60-94f5-1765387d7294 could not be found. Sep 25 04:42:52.256122 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:42:52.256122 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:42:52.256122 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:42:52.256122 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:42:52.256122 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:42:52.256122 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:42:52.256122 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:42:52.256122 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:42:52.256122 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1348d173-f0db-4d60-94f5-1765387d7294 could not be found. Sep 25 04:42:52.256122 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:42:52.257241 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-60b6a6d3-05dd-41d9-bdef-1b9ababc72dd tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Returning 404 to user: Instance 1348d173-f0db-4d60-94f5-1765387d7294 could not be found. {{(pid=127141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:42:52.257241 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-60b6a6d3-05dd-41d9-bdef-1b9ababc72dd tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294" status: 404 len: 111 microversion: 2.1 time: 0.032185 Sep 25 04:42:52.257241 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 357/770] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:42:52 2022] GET /compute/v2.1/servers/1348d173-f0db-4d60-94f5-1765387d7294 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 04:42:52.262510 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-c255d2e8-98b9-474d-babd-d8a5897ee43e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '.version_select at 0x7f4d3eb5ef70>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:52.281814 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-c255d2e8-98b9-474d-babd-d8a5897ee43e tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-559871816" status: 202 len: 0 microversion: 2.1 time: 0.022964 Sep 25 04:42:52.282441 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 414/771] 10.222.0.25 () {58 vars in 1218 bytes} [Sun Sep 25 04:42:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-559871816 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 04:42:52.490163 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [req-f908cd50-54e5-45ab-b218-059d4db0d7a8 req-4c2b00e1-719f-4bb9-908e-c3d00ac8a041 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9e99419-ae76-4d84-9e7a-d0a31530ea14", "name": "network-vif-deleted", "tag": "28807ae7-bb46-4e31-93d7-48170864edca"}]} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:42:52.514262 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-f908cd50-54e5-45ab-b218-059d4db0d7a8 req-4c2b00e1-719f-4bb9-908e-c3d00ac8a041 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:52.526035 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-f908cd50-54e5-45ab-b218-059d4db0d7a8 req-4c2b00e1-719f-4bb9-908e-c3d00ac8a041 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:52.526581 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-f908cd50-54e5-45ab-b218-059d4db0d7a8 req-4c2b00e1-719f-4bb9-908e-c3d00ac8a041 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:52.543912 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.compute.server_external_events [req-f908cd50-54e5-45ab-b218-059d4db0d7a8 req-4c2b00e1-719f-4bb9-908e-c3d00ac8a041 service nova] Creating event network-vif-deleted:28807ae7-bb46-4e31-93d7-48170864edca for instance c9e99419-ae76-4d84-9e7a-d0a31530ea14 on hv-cinder-85535 Sep 25 04:42:52.550577 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [req-f908cd50-54e5-45ab-b218-059d4db0d7a8 req-4c2b00e1-719f-4bb9-908e-c3d00ac8a041 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069560 Sep 25 04:42:52.552251 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 358/772] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:42:52.913451 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-25f932e4-fc14-43f7-993f-ca4f91368924 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:52.915422 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-25f932e4-fc14-43f7-993f-ca4f91368924 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:52.940753 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-25f932e4-fc14-43f7-993f-ca4f91368924 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:52.943788 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-25f932e4-fc14-43f7-993f-ca4f91368924 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:52.944452 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-25f932e4-fc14-43f7-993f-ca4f91368924 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:52.945377 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-25f932e4-fc14-43f7-993f-ca4f91368924 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:52.946152 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-25f932e4-fc14-43f7-993f-ca4f91368924 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:52.947286 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-25f932e4-fc14-43f7-993f-ca4f91368924 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:52.998109 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-25f932e4-fc14-43f7-993f-ca4f91368924 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:52.998628 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-25f932e4-fc14-43f7-993f-ca4f91368924 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:52.999120 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-25f932e4-fc14-43f7-993f-ca4f91368924 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:52.999597 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.objects.instance [None req-25f932e4-fc14-43f7-993f-ca4f91368924 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lazy-loading 'fault' on Instance uuid c9e99419-ae76-4d84-9e7a-d0a31530ea14 {{(pid=127142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 04:42:53.049544 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-25f932e4-fc14-43f7-993f-ca4f91368924 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:53.059726 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-25f932e4-fc14-43f7-993f-ca4f91368924 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:53.061292 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-25f932e4-fc14-43f7-993f-ca4f91368924 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:53.063292 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-25f932e4-fc14-43f7-993f-ca4f91368924 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 200 len: 1372 microversion: 2.20 time: 0.155016 Sep 25 04:42:53.063927 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 415/773] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:42:52 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:42:54.090022 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-d78e8511-dbbd-4968-9709-b1187543b377 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:54.090708 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-d78e8511-dbbd-4968-9709-b1187543b377 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:54.096914 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d78e8511-dbbd-4968-9709-b1187543b377 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:54.097394 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d78e8511-dbbd-4968-9709-b1187543b377 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:54.097883 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d78e8511-dbbd-4968-9709-b1187543b377 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:54.098719 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d78e8511-dbbd-4968-9709-b1187543b377 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:54.099169 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d78e8511-dbbd-4968-9709-b1187543b377 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:54.099590 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d78e8511-dbbd-4968-9709-b1187543b377 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:54.112551 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.wsgi [None req-d78e8511-dbbd-4968-9709-b1187543b377 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] HTTP exception thrown: Instance c9e99419-ae76-4d84-9e7a-d0a31530ea14 could not be found. Sep 25 04:42:54.114709 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-d78e8511-dbbd-4968-9709-b1187543b377 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Request method failure captured: Sep 25 04:42:54.114709 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: request: GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 HTTP/1.1 Sep 25 04:42:54.114709 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept: application/json Sep 25 04:42:54.114709 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept-Encoding: identity Sep 25 04:42:54.114709 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Connection: close Sep 25 04:42:54.114709 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Length: 0 Sep 25 04:42:54.114709 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Type: application/json Sep 25 04:42:54.114709 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Host: 10.222.0.25 Sep 25 04:42:54.114709 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Openstack-System-Scope: None Sep 25 04:42:54.114709 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: User-Agent: python-urllib3/1.26.12 Sep 25 04:42:54.114709 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Auth-Token: gAAAAABjL9qz254B1IcdEE-jUCUffbcyaH8oenu0AtiZ85BV4soEbolOg6vHesZhC66QsiGG84RhbrH-yq9-yj99hy_H051ERXQnYAv_UhbU3XhO2au4Jq1wfmlbcf13L2NY-T_4qwjLr8S197h_Y80p8jUjAA0HxulUK32OmVCk6AfdHbjudME Sep 25 04:42:54.114709 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Id: None Sep 25 04:42:54.114709 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Name: None Sep 25 04:42:54.114709 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Identity-Status: Confirmed Sep 25 04:42:54.114709 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Is-Admin-Project: True Sep 25 04:42:54.114709 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Openstack-Nova-Api-Version: 2.20 Sep 25 04:42:54.114709 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Id: default Sep 25 04:42:54.114709 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Name: Default Sep 25 04:42:54.114709 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Id: a2ac515b97884375b3e85c6e54de81bc Sep 25 04:42:54.114709 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1149609715 Sep 25 04:42:54.114709 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Role: reader,member Sep 25 04:42:54.114709 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Roles: reader,member Sep 25 04:42:54.116412 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a2ac515b97884375b3e85c6e54de81bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2ac515b97884375b3e85c6e54de81bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2ac515b97884375b3e85c6e54de81bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a2ac515b97884375b3e85c6e54de81bc"}]}] Sep 25 04:42:54.116412 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1149609715 Sep 25 04:42:54.116412 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Id: a2ac515b97884375b3e85c6e54de81bc Sep 25 04:42:54.116412 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1149609715 Sep 25 04:42:54.116412 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User: tempest-AttachVolumeShelveTestJSON-1149609715-project Sep 25 04:42:54.116412 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Id: default Sep 25 04:42:54.116412 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Name: Default Sep 25 04:42:54.116412 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Id: e7354aa144df4ad69cd7d12f11b1d8a5 Sep 25 04:42:54.116412 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1149609715-project Sep 25 04:42:54.116412 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: method: > Sep 25 04:42:54.116412 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: exception: Instance c9e99419-ae76-4d84-9e7a-d0a31530ea14 could not be found. Sep 25 04:42:54.116412 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: action_args: {'id': 'c9e99419-ae76-4d84-9e7a-d0a31530ea14'} Sep 25 04:42:54.117481 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:42:54.117481 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:42:54.117481 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:42:54.117481 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:42:54.117481 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:42:54.117481 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:42:54.117481 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:42:54.117481 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:42:54.117481 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:42:54.117481 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:42:54.117481 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9e99419-ae76-4d84-9e7a-d0a31530ea14 could not be found. Sep 25 04:42:54.117481 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:42:54.117481 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:42:54.117481 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:42:54.117481 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:42:54.117481 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:42:54.117481 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:42:54.117481 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:42:54.117481 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:42:54.117481 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:42:54.119325 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:42:54.119325 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 04:42:54.119325 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 04:42:54.119325 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:42:54.119325 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:42:54.119325 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:42:54.119325 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:42:54.119325 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9e99419-ae76-4d84-9e7a-d0a31530ea14 could not be found. Sep 25 04:42:54.119325 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:42:54.119325 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:42:54.119325 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:42:54.119325 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:42:54.119325 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:42:54.119325 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:42:54.119325 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:42:54.119325 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:42:54.119325 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9e99419-ae76-4d84-9e7a-d0a31530ea14 could not be found. Sep 25 04:42:54.119325 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:42:54.121059 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-d78e8511-dbbd-4968-9709-b1187543b377 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Returning 404 to user: Instance c9e99419-ae76-4d84-9e7a-d0a31530ea14 could not be found. {{(pid=127141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:42:54.121059 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-d78e8511-dbbd-4968-9709-b1187543b377 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 404 len: 111 microversion: 2.20 time: 0.031098 Sep 25 04:42:54.121059 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 359/774] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:42:54 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 25 04:42:54.125344 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-24aff94c-5882-4468-9a91-fbbc29ed8362 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '.version_select at 0x7f4d3ebc0b80>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:54.144995 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-24aff94c-5882-4468-9a91-fbbc29ed8362 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1452435516" status: 204 len: 0 microversion: 2.20 time: 0.023498 Sep 25 04:42:54.145571 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 416/775] 10.222.0.25 () {60 vars in 1262 bytes} [Sun Sep 25 04:42:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1452435516 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 25 04:42:54.798816 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-e90d9ad2-250d-496f-9896-3aa1890dd50d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Action: 'create', calling method: .version_select at 0x7f4d3ecd1940>, body: {"keypair": {"name": "tempest-keypair-1995613388", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCzAfT8ESz8BdvUbhmfc+mg9UcBwRPOj7Sf08H1iVx8TeJSQwRz0miEB9rl66UJZGVKlEa5rdZgZsQLtRSeCBRvQlbFlMFy88I/q3Nr9IhU9VxzV6j+/L5qvpjl9kBwsw=="}} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:42:54.815959 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.quota [None req-e90d9ad2-250d-496f-9896-3aa1890dd50d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Getting quotas for project a2ac515b97884375b3e85c6e54de81bc. Resources: {'key_pairs'} {{(pid=127141) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 04:42:54.820819 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.quota [None req-e90d9ad2-250d-496f-9896-3aa1890dd50d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Getting quotas for user e7354aa144df4ad69cd7d12f11b1d8a5 and project a2ac515b97884375b3e85c6e54de81bc. Resources: {'key_pairs'} {{(pid=127141) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 04:42:54.844224 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-e90d9ad2-250d-496f-9896-3aa1890dd50d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.049303 Sep 25 04:42:54.844854 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 360/776] 10.222.0.25 () {62 vars in 1200 bytes} [Sun Sep 25 04:42:54 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 25 04:42:55.292229 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-da66ebfe-a145-43cd-b47c-49f9248a8202 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:55.292912 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-da66ebfe-a145-43cd-b47c-49f9248a8202 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:55.299688 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-da66ebfe-a145-43cd-b47c-49f9248a8202 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:55.300251 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-da66ebfe-a145-43cd-b47c-49f9248a8202 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:55.300716 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-da66ebfe-a145-43cd-b47c-49f9248a8202 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:55.301480 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-da66ebfe-a145-43cd-b47c-49f9248a8202 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:55.301935 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-da66ebfe-a145-43cd-b47c-49f9248a8202 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:55.302492 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-da66ebfe-a145-43cd-b47c-49f9248a8202 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:55.329617 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-da66ebfe-a145-43cd-b47c-49f9248a8202 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Going to try to terminate instance {{(pid=127142) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 04:42:55.408714 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-da66ebfe-a145-43cd-b47c-49f9248a8202 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "DELETE /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 204 len: 0 microversion: 2.1 time: 0.120527 Sep 25 04:42:55.409383 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 417/777] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 25 04:42:55 2022] DELETE /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 04:42:55.417950 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-fb98f069-fe33-4873-baee-9ee01e7e3089 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:55.418664 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-fb98f069-fe33-4873-baee-9ee01e7e3089 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:55.426136 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fb98f069-fe33-4873-baee-9ee01e7e3089 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:55.426926 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fb98f069-fe33-4873-baee-9ee01e7e3089 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:55.427428 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fb98f069-fe33-4873-baee-9ee01e7e3089 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:55.428186 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fb98f069-fe33-4873-baee-9ee01e7e3089 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:55.428734 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fb98f069-fe33-4873-baee-9ee01e7e3089 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:55.429227 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-fb98f069-fe33-4873-baee-9ee01e7e3089 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:55.640736 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-fb98f069-fe33-4873-baee-9ee01e7e3089 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:55.648690 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-fb98f069-fe33-4873-baee-9ee01e7e3089 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1509 microversion: 2.1 time: 0.234828 Sep 25 04:42:55.649259 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 361/778] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:42:55 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1509 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:42:56.412346 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-fc5eb8a7-2d05-4c6c-a092-cab6cf333389 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1693402836", "imageRef": "e5cfdbb2-d0ce-4736-b311-1a3c155844e9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "442ef807-682d-48e2-b151-5ae7fd6da3f5"}], "security_groups": [{"name": "tempest-securitygroup--413538756"}], "key_name": "tempest-keypair-1995613388", "user_data": "}} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:42:56.606425 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.network.neutron [None req-fc5eb8a7-2d05-4c6c-a092-cab6cf333389 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] validate_networks() for [('442ef807-682d-48e2-b151-5ae7fd6da3f5', None, None, None, None, None)] {{(pid=127142) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 04:42:56.671329 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-3cbb40d7-b6ec-4b46-a64f-78dfae03b25d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:56.671961 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-3cbb40d7-b6ec-4b46-a64f-78dfae03b25d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:56.678933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3cbb40d7-b6ec-4b46-a64f-78dfae03b25d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:56.679416 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3cbb40d7-b6ec-4b46-a64f-78dfae03b25d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:56.679925 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3cbb40d7-b6ec-4b46-a64f-78dfae03b25d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:56.680575 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3cbb40d7-b6ec-4b46-a64f-78dfae03b25d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:56.681053 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3cbb40d7-b6ec-4b46-a64f-78dfae03b25d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:56.682127 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3cbb40d7-b6ec-4b46-a64f-78dfae03b25d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:56.950645 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-3cbb40d7-b6ec-4b46-a64f-78dfae03b25d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:56.959319 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-3cbb40d7-b6ec-4b46-a64f-78dfae03b25d tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1509 microversion: 2.1 time: 0.291859 Sep 25 04:42:56.959893 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 362/779] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:42:56 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1509 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:42:57.183107 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [req-5374e671-43c4-4ddc-86c4-f18eea42c70c req-0d63a8f2-0111-4eee-bc72-1414bd905e12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28c97cc6-73d6-4bf6-9d88-e93dad58e7dc", "name": "network-vif-deleted", "tag": "3a4f0d9a-e61b-45f0-b1ce-b92f0048c739"}]} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:42:57.196095 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-5374e671-43c4-4ddc-86c4-f18eea42c70c req-0d63a8f2-0111-4eee-bc72-1414bd905e12 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:57.196900 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-5374e671-43c4-4ddc-86c4-f18eea42c70c req-0d63a8f2-0111-4eee-bc72-1414bd905e12 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:57.197393 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-5374e671-43c4-4ddc-86c4-f18eea42c70c req-0d63a8f2-0111-4eee-bc72-1414bd905e12 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:57.213308 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.compute.server_external_events [req-5374e671-43c4-4ddc-86c4-f18eea42c70c req-0d63a8f2-0111-4eee-bc72-1414bd905e12 service nova] Creating event network-vif-deleted:3a4f0d9a-e61b-45f0-b1ce-b92f0048c739 for instance 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc on hv-cinder-85535 Sep 25 04:42:57.219752 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [req-5374e671-43c4-4ddc-86c4-f18eea42c70c req-0d63a8f2-0111-4eee-bc72-1414bd905e12 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040131 Sep 25 04:42:57.221328 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 363/780] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:42:57.281094 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-fc5eb8a7-2d05-4c6c-a092-cab6cf333389 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Flavor limits 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 04:42:57.281518 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-fc5eb8a7-2d05-4c6c-a092-cab6cf333389 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Image limits 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 04:42:57.282065 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-fc5eb8a7-2d05-4c6c-a092-cab6cf333389 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Flavor pref 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 04:42:57.282466 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-fc5eb8a7-2d05-4c6c-a092-cab6cf333389 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Image pref 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 04:42:57.282867 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-fc5eb8a7-2d05-4c6c-a092-cab6cf333389 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 04:42:57.293337 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fc5eb8a7-2d05-4c6c-a092-cab6cf333389 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:57.293810 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fc5eb8a7-2d05-4c6c-a092-cab6cf333389 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:57.294238 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fc5eb8a7-2d05-4c6c-a092-cab6cf333389 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:57.294954 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fc5eb8a7-2d05-4c6c-a092-cab6cf333389 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:57.295401 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fc5eb8a7-2d05-4c6c-a092-cab6cf333389 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:57.295820 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fc5eb8a7-2d05-4c6c-a092-cab6cf333389 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:57.315765 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.quota [None req-fc5eb8a7-2d05-4c6c-a092-cab6cf333389 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Getting quotas for project a2ac515b97884375b3e85c6e54de81bc. Resources: {'instances', 'ram', 'cores'} {{(pid=127142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 04:42:57.320013 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.quota [None req-fc5eb8a7-2d05-4c6c-a092-cab6cf333389 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Getting quotas for user e7354aa144df4ad69cd7d12f11b1d8a5 and project a2ac515b97884375b3e85c6e54de81bc. Resources: {'instances', 'ram', 'cores'} {{(pid=127142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 04:42:57.331160 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-fc5eb8a7-2d05-4c6c-a092-cab6cf333389 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Going to run 1 instances... {{(pid=127142) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 04:42:57.340103 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-fc5eb8a7-2d05-4c6c-a092-cab6cf333389 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5cfdbb2-d0ce-4736-b311-1a3c155844e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 04:42:57.388123 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-fc5eb8a7-2d05-4c6c-a092-cab6cf333389 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.981210 Sep 25 04:42:57.388976 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 418/781] 10.222.0.25 () {62 vars in 1188 bytes} [Sun Sep 25 04:42:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 983 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 25 04:42:57.401100 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-5478ea18-3e88-473d-b1ae-200bf714fd26 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:57.401801 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-5478ea18-3e88-473d-b1ae-200bf714fd26 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:57.476806 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-5478ea18-3e88-473d-b1ae-200bf714fd26 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:57.484695 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-5478ea18-3e88-473d-b1ae-200bf714fd26 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:57.486389 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-5478ea18-3e88-473d-b1ae-200bf714fd26 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:57.488096 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-5478ea18-3e88-473d-b1ae-200bf714fd26 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1282 microversion: 2.20 time: 0.091198 Sep 25 04:42:57.498065 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 364/782] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:42:57 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1282 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:42:57.983644 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-49b9a460-954a-4e9c-8860-480a429ba5de tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:57.984261 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-49b9a460-954a-4e9c-8860-480a429ba5de tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:57.993244 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-49b9a460-954a-4e9c-8860-480a429ba5de tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:57.993777 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-49b9a460-954a-4e9c-8860-480a429ba5de tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:57.994220 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-49b9a460-954a-4e9c-8860-480a429ba5de tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:57.994987 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-49b9a460-954a-4e9c-8860-480a429ba5de tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:57.995448 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-49b9a460-954a-4e9c-8860-480a429ba5de tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:57.995871 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-49b9a460-954a-4e9c-8860-480a429ba5de tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:58.030477 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-49b9a460-954a-4e9c-8860-480a429ba5de tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:58.030967 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-49b9a460-954a-4e9c-8860-480a429ba5de tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:58.031407 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-49b9a460-954a-4e9c-8860-480a429ba5de tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:58.031858 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.objects.instance [None req-49b9a460-954a-4e9c-8860-480a429ba5de tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lazy-loading 'fault' on Instance uuid 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc {{(pid=127142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 04:42:58.077578 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-49b9a460-954a-4e9c-8860-480a429ba5de tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:58.086072 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-49b9a460-954a-4e9c-8860-480a429ba5de tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 200 len: 1312 microversion: 2.1 time: 0.107179 Sep 25 04:42:58.086834 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 419/783] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:42:57 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 1312 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:42:58.520586 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-e1e145ac-1231-42f3-ad4d-0257928d4762 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:58.521231 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-e1e145ac-1231-42f3-ad4d-0257928d4762 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:58.528320 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e1e145ac-1231-42f3-ad4d-0257928d4762 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:58.528870 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e1e145ac-1231-42f3-ad4d-0257928d4762 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:58.529322 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e1e145ac-1231-42f3-ad4d-0257928d4762 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:58.530005 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e1e145ac-1231-42f3-ad4d-0257928d4762 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:58.530462 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e1e145ac-1231-42f3-ad4d-0257928d4762 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:58.530892 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e1e145ac-1231-42f3-ad4d-0257928d4762 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:58.591796 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-e1e145ac-1231-42f3-ad4d-0257928d4762 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:58.600612 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-e1e145ac-1231-42f3-ad4d-0257928d4762 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:58.602124 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-e1e145ac-1231-42f3-ad4d-0257928d4762 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:58.603227 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-e1e145ac-1231-42f3-ad4d-0257928d4762 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1334 microversion: 2.20 time: 0.086630 Sep 25 04:42:58.603780 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 365/784] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:42:58 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1334 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:42:59.109732 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-c3ef9588-3b9a-458b-b3a7-c82c257bfd65 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:59.110315 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-c3ef9588-3b9a-458b-b3a7-c82c257bfd65 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:59.117555 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c3ef9588-3b9a-458b-b3a7-c82c257bfd65 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:59.118038 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c3ef9588-3b9a-458b-b3a7-c82c257bfd65 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:59.118471 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c3ef9588-3b9a-458b-b3a7-c82c257bfd65 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:59.119157 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c3ef9588-3b9a-458b-b3a7-c82c257bfd65 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:59.119609 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c3ef9588-3b9a-458b-b3a7-c82c257bfd65 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:59.120031 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c3ef9588-3b9a-458b-b3a7-c82c257bfd65 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:59.133218 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.wsgi [None req-c3ef9588-3b9a-458b-b3a7-c82c257bfd65 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] HTTP exception thrown: Instance 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc could not be found. Sep 25 04:42:59.134874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-c3ef9588-3b9a-458b-b3a7-c82c257bfd65 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Request method failure captured: Sep 25 04:42:59.134874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: request: GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc HTTP/1.1 Sep 25 04:42:59.134874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept: application/json Sep 25 04:42:59.134874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept-Encoding: identity Sep 25 04:42:59.134874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Connection: close Sep 25 04:42:59.134874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Length: 0 Sep 25 04:42:59.134874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Type: application/json Sep 25 04:42:59.134874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Host: 10.222.0.25 Sep 25 04:42:59.134874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Openstack-System-Scope: None Sep 25 04:42:59.134874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: User-Agent: python-urllib3/1.26.12 Sep 25 04:42:59.134874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Auth-Token: gAAAAABjL9qqgx9SbwmoscMIXzayDkTaHYe5OsS0R6Y7sMCrDveP0He2ve1AWmZoJjvfku9MDTwEaVSQrNi9P0Yo8NZuEWbmT7VIGNUqGQXykMqiQxqIQpHToYGErquEQDCjI-WfO-ZEE9ccXdKRhNCVIGSYzSyMRRtPFFdQShrVaJWdWp_RDEI Sep 25 04:42:59.134874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Id: None Sep 25 04:42:59.134874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Name: None Sep 25 04:42:59.134874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Identity-Status: Confirmed Sep 25 04:42:59.134874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Is-Admin-Project: True Sep 25 04:42:59.134874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Id: default Sep 25 04:42:59.134874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Name: Default Sep 25 04:42:59.134874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Id: f6f23cf0323f48069e21acf059cbd1f0 Sep 25 04:42:59.134874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1236487579 Sep 25 04:42:59.134874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Role: reader,member Sep 25 04:42:59.134874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Roles: reader,member Sep 25 04:42:59.136248 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f6f23cf0323f48069e21acf059cbd1f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6f23cf0323f48069e21acf059cbd1f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6f23cf0323f48069e21acf059cbd1f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f6f23cf0323f48069e21acf059cbd1f0"}]}] Sep 25 04:42:59.136248 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1236487579 Sep 25 04:42:59.136248 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Id: f6f23cf0323f48069e21acf059cbd1f0 Sep 25 04:42:59.136248 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1236487579 Sep 25 04:42:59.136248 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User: tempest-ServerRescueNegativeTestJSON-1236487579-project Sep 25 04:42:59.136248 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Id: default Sep 25 04:42:59.136248 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Name: Default Sep 25 04:42:59.136248 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Id: 2666d4774776498bbdbce539296e76a9 Sep 25 04:42:59.136248 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1236487579-project Sep 25 04:42:59.136248 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: method: > Sep 25 04:42:59.136248 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: exception: Instance 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc could not be found. Sep 25 04:42:59.136248 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: action_args: {'id': '28c97cc6-73d6-4bf6-9d88-e93dad58e7dc'} Sep 25 04:42:59.137101 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:42:59.137101 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:42:59.137101 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:42:59.137101 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:42:59.137101 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:42:59.137101 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:42:59.137101 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:42:59.137101 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:42:59.137101 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:42:59.137101 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:42:59.137101 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc could not be found. Sep 25 04:42:59.137101 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:42:59.137101 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:42:59.137101 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:42:59.137101 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:42:59.137101 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:42:59.137101 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:42:59.137101 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:42:59.137101 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:42:59.137101 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:42:59.138384 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:42:59.138384 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 04:42:59.138384 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 04:42:59.138384 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:42:59.138384 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:42:59.138384 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:42:59.138384 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:42:59.138384 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc could not be found. Sep 25 04:42:59.138384 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:42:59.138384 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:42:59.138384 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:42:59.138384 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:42:59.138384 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:42:59.138384 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:42:59.138384 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:42:59.138384 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:42:59.138384 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc could not be found. Sep 25 04:42:59.138384 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:42:59.139482 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-c3ef9588-3b9a-458b-b3a7-c82c257bfd65 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Returning 404 to user: Instance 28c97cc6-73d6-4bf6-9d88-e93dad58e7dc could not be found. {{(pid=127142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:42:59.139482 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-c3ef9588-3b9a-458b-b3a7-c82c257bfd65 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc" status: 404 len: 111 microversion: 2.1 time: 0.030424 Sep 25 04:42:59.139482 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 420/785] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:42:59 2022] GET /compute/v2.1/servers/28c97cc6-73d6-4bf6-9d88-e93dad58e7dc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 04:42:59.144802 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-47d29be0-5c9b-4173-9edc-42913acc9ca0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:59.145413 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-47d29be0-5c9b-4173-9edc-42913acc9ca0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 8a4fe760-3afd-42e5-9909-86ca268c9b96] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:59.151417 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-47d29be0-5c9b-4173-9edc-42913acc9ca0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:59.151898 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-47d29be0-5c9b-4173-9edc-42913acc9ca0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:59.152337 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-47d29be0-5c9b-4173-9edc-42913acc9ca0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:59.153057 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-47d29be0-5c9b-4173-9edc-42913acc9ca0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:59.153508 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-47d29be0-5c9b-4173-9edc-42913acc9ca0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:59.153933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-47d29be0-5c9b-4173-9edc-42913acc9ca0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:59.179571 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-47d29be0-5c9b-4173-9edc-42913acc9ca0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 8a4fe760-3afd-42e5-9909-86ca268c9b96] Going to try to terminate instance {{(pid=127141) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 04:42:59.257418 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-47d29be0-5c9b-4173-9edc-42913acc9ca0 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96" status: 204 len: 0 microversion: 2.1 time: 0.116177 Sep 25 04:42:59.258223 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 366/786] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 25 04:42:59 2022] DELETE /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 04:42:59.266194 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-27c8732d-2441-42be-8f64-808a5f6fe833 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:59.266928 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-27c8732d-2441-42be-8f64-808a5f6fe833 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 8a4fe760-3afd-42e5-9909-86ca268c9b96] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:59.274047 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-27c8732d-2441-42be-8f64-808a5f6fe833 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:59.274621 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-27c8732d-2441-42be-8f64-808a5f6fe833 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:59.275137 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-27c8732d-2441-42be-8f64-808a5f6fe833 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:59.275932 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-27c8732d-2441-42be-8f64-808a5f6fe833 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:59.276470 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-27c8732d-2441-42be-8f64-808a5f6fe833 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:59.277076 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-27c8732d-2441-42be-8f64-808a5f6fe833 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:59.484656 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-27c8732d-2441-42be-8f64-808a5f6fe833 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:59.493193 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-27c8732d-2441-42be-8f64-808a5f6fe833 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96" status: 200 len: 1522 microversion: 2.1 time: 0.231079 Sep 25 04:42:59.493962 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 421/787] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:42:59 2022] GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:42:59.629673 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-e9c83263-a8cd-4b80-829c-9dbc234cbd3b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:42:59.630690 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-e9c83263-a8cd-4b80-829c-9dbc234cbd3b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:42:59.638735 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e9c83263-a8cd-4b80-829c-9dbc234cbd3b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:59.644663 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e9c83263-a8cd-4b80-829c-9dbc234cbd3b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:59.645741 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e9c83263-a8cd-4b80-829c-9dbc234cbd3b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:59.646753 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e9c83263-a8cd-4b80-829c-9dbc234cbd3b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:42:59.647042 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e9c83263-a8cd-4b80-829c-9dbc234cbd3b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:42:59.647473 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e9c83263-a8cd-4b80-829c-9dbc234cbd3b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:42:59.832376 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-e9c83263-a8cd-4b80-829c-9dbc234cbd3b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:59.840906 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-e9c83263-a8cd-4b80-829c-9dbc234cbd3b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:59.842352 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-e9c83263-a8cd-4b80-829c-9dbc234cbd3b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:42:59.843451 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-e9c83263-a8cd-4b80-829c-9dbc234cbd3b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1407 microversion: 2.20 time: 0.218895 Sep 25 04:42:59.844004 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 367/788] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:42:59 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:43:00.516729 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-5919d822-def8-4f62-b699-a1ed18ca8308 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:00.517350 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-5919d822-def8-4f62-b699-a1ed18ca8308 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 8a4fe760-3afd-42e5-9909-86ca268c9b96] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:00.524372 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5919d822-def8-4f62-b699-a1ed18ca8308 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:00.524902 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5919d822-def8-4f62-b699-a1ed18ca8308 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:00.525347 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5919d822-def8-4f62-b699-a1ed18ca8308 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:00.526038 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5919d822-def8-4f62-b699-a1ed18ca8308 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:00.526496 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5919d822-def8-4f62-b699-a1ed18ca8308 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:00.526926 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5919d822-def8-4f62-b699-a1ed18ca8308 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:00.658605 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-5919d822-def8-4f62-b699-a1ed18ca8308 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:00.666381 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-5919d822-def8-4f62-b699-a1ed18ca8308 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96" status: 200 len: 1522 microversion: 2.1 time: 0.153620 Sep 25 04:43:00.666939 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 422/789] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:43:00 2022] GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:43:00.871253 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-e255e042-91f2-4554-bc08-3a9d3d8d1861 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:00.871784 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-e255e042-91f2-4554-bc08-3a9d3d8d1861 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:00.878209 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e255e042-91f2-4554-bc08-3a9d3d8d1861 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:00.878735 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e255e042-91f2-4554-bc08-3a9d3d8d1861 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:00.879738 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e255e042-91f2-4554-bc08-3a9d3d8d1861 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:00.880429 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e255e042-91f2-4554-bc08-3a9d3d8d1861 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:00.880913 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e255e042-91f2-4554-bc08-3a9d3d8d1861 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:00.881340 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e255e042-91f2-4554-bc08-3a9d3d8d1861 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:01.011846 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-e255e042-91f2-4554-bc08-3a9d3d8d1861 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:01.020124 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-e255e042-91f2-4554-bc08-3a9d3d8d1861 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:01.021820 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-e255e042-91f2-4554-bc08-3a9d3d8d1861 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:01.022932 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-e255e042-91f2-4554-bc08-3a9d3d8d1861 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1407 microversion: 2.20 time: 0.157662 Sep 25 04:43:01.023491 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 368/790] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:43:00 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:43:01.688189 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-d67de3e2-a136-42c1-9f04-ce708529de97 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:01.688826 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-d67de3e2-a136-42c1-9f04-ce708529de97 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 8a4fe760-3afd-42e5-9909-86ca268c9b96] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:01.695903 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d67de3e2-a136-42c1-9f04-ce708529de97 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:01.696386 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d67de3e2-a136-42c1-9f04-ce708529de97 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:01.696860 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d67de3e2-a136-42c1-9f04-ce708529de97 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:01.697543 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d67de3e2-a136-42c1-9f04-ce708529de97 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:01.697994 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d67de3e2-a136-42c1-9f04-ce708529de97 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:01.698415 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d67de3e2-a136-42c1-9f04-ce708529de97 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:01.829818 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-d67de3e2-a136-42c1-9f04-ce708529de97 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:01.838550 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-d67de3e2-a136-42c1-9f04-ce708529de97 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96" status: 200 len: 1522 microversion: 2.1 time: 0.154212 Sep 25 04:43:01.839108 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 423/791] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:43:01 2022] GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:43:02.047451 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-7393560e-87d5-4065-aaa7-be3a9c1590de tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:02.048110 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-7393560e-87d5-4065-aaa7-be3a9c1590de tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:02.055341 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7393560e-87d5-4065-aaa7-be3a9c1590de tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:02.055829 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7393560e-87d5-4065-aaa7-be3a9c1590de tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:02.056266 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7393560e-87d5-4065-aaa7-be3a9c1590de tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:02.056997 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7393560e-87d5-4065-aaa7-be3a9c1590de tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:02.057456 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7393560e-87d5-4065-aaa7-be3a9c1590de tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:02.057916 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7393560e-87d5-4065-aaa7-be3a9c1590de tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:02.267223 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-7393560e-87d5-4065-aaa7-be3a9c1590de tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:02.276225 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-7393560e-87d5-4065-aaa7-be3a9c1590de tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:02.277707 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-7393560e-87d5-4065-aaa7-be3a9c1590de tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:02.278823 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-7393560e-87d5-4065-aaa7-be3a9c1590de tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1407 microversion: 2.20 time: 0.235348 Sep 25 04:43:02.279573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 369/792] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:43:02 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:43:02.636263 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-abcd2dab-5aa8-4ff7-9912-037f1ef9bef6 req-f844ba78-5e5e-4d74-b681-2da62768af05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ae04d96-b4dc-4acf-9f79-4f6644c1a082", "tag": "67e59d38-b12f-4f51-bb79-591d93062336"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:43:02.645751 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-abcd2dab-5aa8-4ff7-9912-037f1ef9bef6 req-f844ba78-5e5e-4d74-b681-2da62768af05 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:02.646233 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-abcd2dab-5aa8-4ff7-9912-037f1ef9bef6 req-f844ba78-5e5e-4d74-b681-2da62768af05 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:02.646666 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-abcd2dab-5aa8-4ff7-9912-037f1ef9bef6 req-f844ba78-5e5e-4d74-b681-2da62768af05 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:02.659355 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-abcd2dab-5aa8-4ff7-9912-037f1ef9bef6 req-f844ba78-5e5e-4d74-b681-2da62768af05 service nova] Creating event network-changed:67e59d38-b12f-4f51-bb79-591d93062336 for instance 8ae04d96-b4dc-4acf-9f79-4f6644c1a082 on hv-cinder-85535 Sep 25 04:43:02.664544 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-abcd2dab-5aa8-4ff7-9912-037f1ef9bef6 req-f844ba78-5e5e-4d74-b681-2da62768af05 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031991 Sep 25 04:43:02.665175 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 424/793] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:43:02.861385 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-a60978a1-88d8-4d13-8ae7-5ec0db708210 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:02.863936 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-a60978a1-88d8-4d13-8ae7-5ec0db708210 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 8a4fe760-3afd-42e5-9909-86ca268c9b96] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:02.870141 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a60978a1-88d8-4d13-8ae7-5ec0db708210 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:02.870632 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a60978a1-88d8-4d13-8ae7-5ec0db708210 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:02.871115 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a60978a1-88d8-4d13-8ae7-5ec0db708210 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:02.871744 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a60978a1-88d8-4d13-8ae7-5ec0db708210 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:02.872193 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a60978a1-88d8-4d13-8ae7-5ec0db708210 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:02.872620 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a60978a1-88d8-4d13-8ae7-5ec0db708210 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:02.956408 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-2c9437be-290e-45e3-9d2d-409e28e930d7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:02.958808 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-2c9437be-290e-45e3-9d2d-409e28e930d7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:02.965370 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2c9437be-290e-45e3-9d2d-409e28e930d7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:02.965923 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2c9437be-290e-45e3-9d2d-409e28e930d7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:02.966445 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2c9437be-290e-45e3-9d2d-409e28e930d7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:02.967192 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2c9437be-290e-45e3-9d2d-409e28e930d7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:02.967712 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2c9437be-290e-45e3-9d2d-409e28e930d7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:02.968224 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2c9437be-290e-45e3-9d2d-409e28e930d7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:02.999795 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-2c9437be-290e-45e3-9d2d-409e28e930d7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048199 Sep 25 04:43:03.000365 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 425/794] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 25 04:43:02 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 25 04:43:03.065891 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-4fe8ea37-63e5-4115-8573-00530c4d4574 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:03.066412 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-4fe8ea37-63e5-4115-8573-00530c4d4574 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:03.072655 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4fe8ea37-63e5-4115-8573-00530c4d4574 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:03.073152 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4fe8ea37-63e5-4115-8573-00530c4d4574 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:03.073585 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4fe8ea37-63e5-4115-8573-00530c4d4574 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:03.074269 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4fe8ea37-63e5-4115-8573-00530c4d4574 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:03.074722 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4fe8ea37-63e5-4115-8573-00530c4d4574 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:03.075144 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4fe8ea37-63e5-4115-8573-00530c4d4574 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:03.101829 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-4fe8ea37-63e5-4115-8573-00530c4d4574 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Going to try to terminate instance {{(pid=127142) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 04:43:03.184151 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-4fe8ea37-63e5-4115-8573-00530c4d4574 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 204 len: 0 microversion: 2.1 time: 0.121668 Sep 25 04:43:03.184940 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 426/795] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 25 04:43:03 2022] DELETE /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 25 04:43:03.193892 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-1dfa53f0-f827-49f1-82f1-ff9ff088e791 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:03.194748 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-1dfa53f0-f827-49f1-82f1-ff9ff088e791 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:03.200887 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1dfa53f0-f827-49f1-82f1-ff9ff088e791 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:03.201481 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1dfa53f0-f827-49f1-82f1-ff9ff088e791 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:03.201995 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1dfa53f0-f827-49f1-82f1-ff9ff088e791 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:03.202706 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1dfa53f0-f827-49f1-82f1-ff9ff088e791 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:03.203164 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1dfa53f0-f827-49f1-82f1-ff9ff088e791 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:03.203588 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1dfa53f0-f827-49f1-82f1-ff9ff088e791 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:03.221208 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-a60978a1-88d8-4d13-8ae7-5ec0db708210 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:03.231181 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-a60978a1-88d8-4d13-8ae7-5ec0db708210 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96" status: 200 len: 1522 microversion: 2.1 time: 0.373606 Sep 25 04:43:03.232271 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 370/796] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:43:02 2022] GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96 => generated 1522 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:43:03.304169 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-c361106b-9cbf-4407-aa75-a35be5e71b26 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:03.304924 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-c361106b-9cbf-4407-aa75-a35be5e71b26 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:03.310999 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c361106b-9cbf-4407-aa75-a35be5e71b26 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:03.311755 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c361106b-9cbf-4407-aa75-a35be5e71b26 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:03.312199 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c361106b-9cbf-4407-aa75-a35be5e71b26 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:03.312921 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c361106b-9cbf-4407-aa75-a35be5e71b26 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:03.313540 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c361106b-9cbf-4407-aa75-a35be5e71b26 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:03.313973 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c361106b-9cbf-4407-aa75-a35be5e71b26 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:03.533280 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-1dfa53f0-f827-49f1-82f1-ff9ff088e791 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:03.541079 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-1dfa53f0-f827-49f1-82f1-ff9ff088e791 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1676 microversion: 2.1 time: 0.351370 Sep 25 04:43:03.541660 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 427/797] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:43:03 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1676 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:43:03.575779 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-c361106b-9cbf-4407-aa75-a35be5e71b26 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:03.585765 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-c361106b-9cbf-4407-aa75-a35be5e71b26 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:03.587232 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-c361106b-9cbf-4407-aa75-a35be5e71b26 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:03.588594 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-c361106b-9cbf-4407-aa75-a35be5e71b26 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1407 microversion: 2.20 time: 0.289086 Sep 25 04:43:03.589173 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 371/798] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:43:03 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1407 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:43:04.255378 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-327759e5-5675-459b-b2e8-7c9083907026 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:04.255934 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-327759e5-5675-459b-b2e8-7c9083907026 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 8a4fe760-3afd-42e5-9909-86ca268c9b96] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:04.262726 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-327759e5-5675-459b-b2e8-7c9083907026 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:04.263195 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-327759e5-5675-459b-b2e8-7c9083907026 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:04.263634 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-327759e5-5675-459b-b2e8-7c9083907026 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:04.264339 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-327759e5-5675-459b-b2e8-7c9083907026 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:04.264835 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-327759e5-5675-459b-b2e8-7c9083907026 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:04.265262 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-327759e5-5675-459b-b2e8-7c9083907026 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:04.285673 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:43:04.302993 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-327759e5-5675-459b-b2e8-7c9083907026 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:04.303498 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-327759e5-5675-459b-b2e8-7c9083907026 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:04.303923 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-327759e5-5675-459b-b2e8-7c9083907026 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:04.304549 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.objects.instance [None req-327759e5-5675-459b-b2e8-7c9083907026 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lazy-loading 'fault' on Instance uuid 8a4fe760-3afd-42e5-9909-86ca268c9b96 {{(pid=127142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 04:43:04.522240 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-327759e5-5675-459b-b2e8-7c9083907026 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2666d4774776498bbdbce539296e76a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f23cf0323f48069e21acf059cbd1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:04.529848 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-327759e5-5675-459b-b2e8-7c9083907026 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96" status: 200 len: 1312 microversion: 2.1 time: 0.278614 Sep 25 04:43:04.530414 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 428/799] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:43:04 2022] GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96 => generated 1312 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:43:04.564310 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-d8b4d4ff-3c47-43e0-9e88-794a29bbe490 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:04.564974 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-d8b4d4ff-3c47-43e0-9e88-794a29bbe490 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:04.572390 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d8b4d4ff-3c47-43e0-9e88-794a29bbe490 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:04.572913 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d8b4d4ff-3c47-43e0-9e88-794a29bbe490 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:04.573349 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d8b4d4ff-3c47-43e0-9e88-794a29bbe490 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:04.574031 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d8b4d4ff-3c47-43e0-9e88-794a29bbe490 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:04.574482 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d8b4d4ff-3c47-43e0-9e88-794a29bbe490 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:04.574904 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d8b4d4ff-3c47-43e0-9e88-794a29bbe490 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:04.615069 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-0412774a-20cb-44a9-b361-86eb4f8f5b76 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:04.615822 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-0412774a-20cb-44a9-b361-86eb4f8f5b76 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:04.621988 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0412774a-20cb-44a9-b361-86eb4f8f5b76 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:04.622562 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0412774a-20cb-44a9-b361-86eb4f8f5b76 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:04.623111 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0412774a-20cb-44a9-b361-86eb4f8f5b76 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:04.623883 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0412774a-20cb-44a9-b361-86eb4f8f5b76 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:04.624416 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0412774a-20cb-44a9-b361-86eb4f8f5b76 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:04.624943 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0412774a-20cb-44a9-b361-86eb4f8f5b76 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:04.796624 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-d8b4d4ff-3c47-43e0-9e88-794a29bbe490 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:04.805037 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-d8b4d4ff-3c47-43e0-9e88-794a29bbe490 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1676 microversion: 2.1 time: 0.244476 Sep 25 04:43:04.805597 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 372/800] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:43:04 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1676 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:43:04.816288 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [req-8f931607-3195-4e68-85c9-bc08445fa8b6 req-25c38886-79b4-47c2-a1fc-62c8eaa8cbc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a4fe760-3afd-42e5-9909-86ca268c9b96", "name": "network-vif-deleted", "tag": "320631df-79bd-4e26-a748-a2b0a3daee05"}]} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:43:04.826203 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-8f931607-3195-4e68-85c9-bc08445fa8b6 req-25c38886-79b4-47c2-a1fc-62c8eaa8cbc1 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:04.826742 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-8f931607-3195-4e68-85c9-bc08445fa8b6 req-25c38886-79b4-47c2-a1fc-62c8eaa8cbc1 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:04.827210 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-8f931607-3195-4e68-85c9-bc08445fa8b6 req-25c38886-79b4-47c2-a1fc-62c8eaa8cbc1 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:04.828263 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-0412774a-20cb-44a9-b361-86eb4f8f5b76 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:04.837232 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-0412774a-20cb-44a9-b361-86eb4f8f5b76 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:04.838362 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.compute.server_external_events [req-8f931607-3195-4e68-85c9-bc08445fa8b6 req-25c38886-79b4-47c2-a1fc-62c8eaa8cbc1 service nova] Creating event network-vif-deleted:320631df-79bd-4e26-a748-a2b0a3daee05 for instance 8a4fe760-3afd-42e5-9909-86ca268c9b96 on hv-cinder-85535 Sep 25 04:43:04.839291 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-0412774a-20cb-44a9-b361-86eb4f8f5b76 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:04.840525 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-0412774a-20cb-44a9-b361-86eb4f8f5b76 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1407 microversion: 2.20 time: 0.230821 Sep 25 04:43:04.841414 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 429/801] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:43:04 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 04:43:04.843415 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [req-8f931607-3195-4e68-85c9-bc08445fa8b6 req-25c38886-79b4-47c2-a1fc-62c8eaa8cbc1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030634 Sep 25 04:43:04.844168 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 373/802] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:43:05.552772 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-b0d91bdc-192e-4cab-b98d-cec300117439 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:05.553387 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-b0d91bdc-192e-4cab-b98d-cec300117439 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] [instance: 8a4fe760-3afd-42e5-9909-86ca268c9b96] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:05.560081 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b0d91bdc-192e-4cab-b98d-cec300117439 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:05.560570 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b0d91bdc-192e-4cab-b98d-cec300117439 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:05.561036 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b0d91bdc-192e-4cab-b98d-cec300117439 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:05.561722 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b0d91bdc-192e-4cab-b98d-cec300117439 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:05.562172 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b0d91bdc-192e-4cab-b98d-cec300117439 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:05.562593 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b0d91bdc-192e-4cab-b98d-cec300117439 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:05.576212 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.wsgi [None req-b0d91bdc-192e-4cab-b98d-cec300117439 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] HTTP exception thrown: Instance 8a4fe760-3afd-42e5-9909-86ca268c9b96 could not be found. Sep 25 04:43:05.577865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-b0d91bdc-192e-4cab-b98d-cec300117439 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Request method failure captured: Sep 25 04:43:05.577865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: request: GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96 HTTP/1.1 Sep 25 04:43:05.577865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept: application/json Sep 25 04:43:05.577865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept-Encoding: identity Sep 25 04:43:05.577865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Connection: close Sep 25 04:43:05.577865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Length: 0 Sep 25 04:43:05.577865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Type: application/json Sep 25 04:43:05.577865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Host: 10.222.0.25 Sep 25 04:43:05.577865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Openstack-System-Scope: None Sep 25 04:43:05.577865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: User-Agent: python-urllib3/1.26.12 Sep 25 04:43:05.577865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Auth-Token: gAAAAABjL9qqgx9SbwmoscMIXzayDkTaHYe5OsS0R6Y7sMCrDveP0He2ve1AWmZoJjvfku9MDTwEaVSQrNi9P0Yo8NZuEWbmT7VIGNUqGQXykMqiQxqIQpHToYGErquEQDCjI-WfO-ZEE9ccXdKRhNCVIGSYzSyMRRtPFFdQShrVaJWdWp_RDEI Sep 25 04:43:05.577865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Id: None Sep 25 04:43:05.577865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Name: None Sep 25 04:43:05.577865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Identity-Status: Confirmed Sep 25 04:43:05.577865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Is-Admin-Project: True Sep 25 04:43:05.577865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Id: default Sep 25 04:43:05.577865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Name: Default Sep 25 04:43:05.577865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Id: f6f23cf0323f48069e21acf059cbd1f0 Sep 25 04:43:05.577865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1236487579 Sep 25 04:43:05.577865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Role: reader,member Sep 25 04:43:05.577865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Roles: reader,member Sep 25 04:43:05.579502 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f6f23cf0323f48069e21acf059cbd1f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6f23cf0323f48069e21acf059cbd1f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6f23cf0323f48069e21acf059cbd1f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f6f23cf0323f48069e21acf059cbd1f0"}]}] Sep 25 04:43:05.579502 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1236487579 Sep 25 04:43:05.579502 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Id: f6f23cf0323f48069e21acf059cbd1f0 Sep 25 04:43:05.579502 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1236487579 Sep 25 04:43:05.579502 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User: tempest-ServerRescueNegativeTestJSON-1236487579-project Sep 25 04:43:05.579502 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Id: default Sep 25 04:43:05.579502 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Name: Default Sep 25 04:43:05.579502 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Id: 2666d4774776498bbdbce539296e76a9 Sep 25 04:43:05.579502 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1236487579-project Sep 25 04:43:05.579502 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: method: > Sep 25 04:43:05.579502 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: exception: Instance 8a4fe760-3afd-42e5-9909-86ca268c9b96 could not be found. Sep 25 04:43:05.579502 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: action_args: {'id': '8a4fe760-3afd-42e5-9909-86ca268c9b96'} Sep 25 04:43:05.580396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:43:05.580396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:43:05.580396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:43:05.580396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:43:05.580396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:43:05.580396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:43:05.580396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:43:05.580396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:43:05.580396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:43:05.580396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:43:05.580396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a4fe760-3afd-42e5-9909-86ca268c9b96 could not be found. Sep 25 04:43:05.580396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:43:05.580396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:43:05.580396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:43:05.580396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:43:05.580396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:43:05.580396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:43:05.580396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:43:05.580396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:43:05.580396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:43:05.582501 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:43:05.582501 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 04:43:05.582501 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 04:43:05.582501 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:43:05.582501 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:43:05.582501 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:43:05.582501 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:43:05.582501 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a4fe760-3afd-42e5-9909-86ca268c9b96 could not be found. Sep 25 04:43:05.582501 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:43:05.582501 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:43:05.582501 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:43:05.582501 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:43:05.582501 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:43:05.582501 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:43:05.582501 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:43:05.582501 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:43:05.582501 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a4fe760-3afd-42e5-9909-86ca268c9b96 could not be found. Sep 25 04:43:05.582501 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:43:05.584067 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-b0d91bdc-192e-4cab-b98d-cec300117439 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] Returning 404 to user: Instance 8a4fe760-3afd-42e5-9909-86ca268c9b96 could not be found. {{(pid=127142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:43:05.584067 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-b0d91bdc-192e-4cab-b98d-cec300117439 tempest-ServerRescueNegativeTestJSON-1236487579 tempest-ServerRescueNegativeTestJSON-1236487579-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96" status: 404 len: 111 microversion: 2.1 time: 0.030436 Sep 25 04:43:05.589735 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 430/803] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:43:05 2022] GET /compute/v2.1/servers/8a4fe760-3afd-42e5-9909-86ca268c9b96 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 04:43:05.830278 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-960c3611-45bc-4df6-91d1-93268d6bebe0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:05.831647 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-960c3611-45bc-4df6-91d1-93268d6bebe0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:05.838877 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-960c3611-45bc-4df6-91d1-93268d6bebe0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:05.839627 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-960c3611-45bc-4df6-91d1-93268d6bebe0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:05.840267 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-960c3611-45bc-4df6-91d1-93268d6bebe0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:05.841067 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-960c3611-45bc-4df6-91d1-93268d6bebe0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:05.841896 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-960c3611-45bc-4df6-91d1-93268d6bebe0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:05.842425 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-960c3611-45bc-4df6-91d1-93268d6bebe0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:05.869342 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-4df755ca-961f-45ae-b60e-5f2f0e6c3e13 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:05.870222 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-4df755ca-961f-45ae-b60e-5f2f0e6c3e13 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:05.877900 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4df755ca-961f-45ae-b60e-5f2f0e6c3e13 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:05.878393 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4df755ca-961f-45ae-b60e-5f2f0e6c3e13 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:05.879925 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4df755ca-961f-45ae-b60e-5f2f0e6c3e13 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:05.880875 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4df755ca-961f-45ae-b60e-5f2f0e6c3e13 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:05.881490 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4df755ca-961f-45ae-b60e-5f2f0e6c3e13 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:05.882330 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4df755ca-961f-45ae-b60e-5f2f0e6c3e13 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:06.109338 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-960c3611-45bc-4df6-91d1-93268d6bebe0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:06.120604 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-960c3611-45bc-4df6-91d1-93268d6bebe0 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1676 microversion: 2.1 time: 0.293879 Sep 25 04:43:06.140740 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 374/804] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:43:05 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1676 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:43:06.174436 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-4df755ca-961f-45ae-b60e-5f2f0e6c3e13 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:06.184122 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-4df755ca-961f-45ae-b60e-5f2f0e6c3e13 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:06.185614 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-4df755ca-961f-45ae-b60e-5f2f0e6c3e13 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:06.186992 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-4df755ca-961f-45ae-b60e-5f2f0e6c3e13 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1407 microversion: 2.20 time: 0.324797 Sep 25 04:43:06.187903 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 431/805] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:43:05 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1407 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:43:06.555343 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-6259ff39-919a-49cc-9eb6-ffcb9ed61673 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1307643562"}} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:43:06.556603 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-6259ff39-919a-49cc-9eb6-ffcb9ed61673 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:06.563876 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6259ff39-919a-49cc-9eb6-ffcb9ed61673 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:06.564837 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6259ff39-919a-49cc-9eb6-ffcb9ed61673 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:06.565460 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6259ff39-919a-49cc-9eb6-ffcb9ed61673 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:06.566717 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6259ff39-919a-49cc-9eb6-ffcb9ed61673 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:06.567344 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6259ff39-919a-49cc-9eb6-ffcb9ed61673 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:06.567936 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6259ff39-919a-49cc-9eb6-ffcb9ed61673 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:06.781742 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.network.security_group_api [None req-6259ff39-919a-49cc-9eb6-ffcb9ed61673 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Removing security group aef11ff3-9e6f-4a68-874c-ad911f0e761c from port 1a0b90ca-b310-46fa-adf6-563e2d00f49d Sep 25 04:43:06.887522 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-da1086d9-472b-4645-9f9d-a38ffe63d3ec req-bea34f1d-5d71-4a42-a88f-4190ef519de2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9be0143-7c91-4fba-8c2c-500f01573632", "name": "network-vif-deleted", "tag": "352ac3fb-d005-4e6e-98b0-7339ef6c2202"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:43:06.904228 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-da1086d9-472b-4645-9f9d-a38ffe63d3ec req-bea34f1d-5d71-4a42-a88f-4190ef519de2 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:06.904892 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-da1086d9-472b-4645-9f9d-a38ffe63d3ec req-bea34f1d-5d71-4a42-a88f-4190ef519de2 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:06.905426 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-da1086d9-472b-4645-9f9d-a38ffe63d3ec req-bea34f1d-5d71-4a42-a88f-4190ef519de2 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:06.920286 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-da1086d9-472b-4645-9f9d-a38ffe63d3ec req-bea34f1d-5d71-4a42-a88f-4190ef519de2 service nova] Creating event network-vif-deleted:352ac3fb-d005-4e6e-98b0-7339ef6c2202 for instance c9be0143-7c91-4fba-8c2c-500f01573632 on hv-cinder-85535 Sep 25 04:43:06.927263 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-da1086d9-472b-4645-9f9d-a38ffe63d3ec req-bea34f1d-5d71-4a42-a88f-4190ef519de2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043369 Sep 25 04:43:06.927872 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 432/806] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:43:07.146697 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-6a26e232-1bc5-42c9-8b8f-d193efcb1389 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:07.147495 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-6a26e232-1bc5-42c9-8b8f-d193efcb1389 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:07.153758 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6a26e232-1bc5-42c9-8b8f-d193efcb1389 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:07.154490 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6a26e232-1bc5-42c9-8b8f-d193efcb1389 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:07.155093 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6a26e232-1bc5-42c9-8b8f-d193efcb1389 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:07.155962 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6a26e232-1bc5-42c9-8b8f-d193efcb1389 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:07.156581 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6a26e232-1bc5-42c9-8b8f-d193efcb1389 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:07.157077 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6a26e232-1bc5-42c9-8b8f-d193efcb1389 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:07.252018 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-6a26e232-1bc5-42c9-8b8f-d193efcb1389 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:07.263338 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-6a26e232-1bc5-42c9-8b8f-d193efcb1389 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1608 microversion: 2.1 time: 0.121085 Sep 25 04:43:07.267737 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 433/807] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:43:07 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1608 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:43:07.274959 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-352bce09-437d-4105-90ff-c716f4b1906f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:07.275583 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-352bce09-437d-4105-90ff-c716f4b1906f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:07.276541 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-6259ff39-919a-49cc-9eb6-ffcb9ed61673 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "POST /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65/action" status: 202 len: 0 microversion: 2.1 time: 0.727139 Sep 25 04:43:07.277297 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 375/808] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 25 04:43:06 2022] POST /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65/action => generated 0 bytes in 729 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 04:43:07.290717 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-352bce09-437d-4105-90ff-c716f4b1906f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:07.291215 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-352bce09-437d-4105-90ff-c716f4b1906f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:07.291679 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-352bce09-437d-4105-90ff-c716f4b1906f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:07.292377 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-352bce09-437d-4105-90ff-c716f4b1906f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:07.293211 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-352bce09-437d-4105-90ff-c716f4b1906f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:07.293637 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-352bce09-437d-4105-90ff-c716f4b1906f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:07.310649 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell0:SELECT=2 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:43:07.338438 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell0:SELECT=6 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:43:07.548947 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-352bce09-437d-4105-90ff-c716f4b1906f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:07.562984 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-352bce09-437d-4105-90ff-c716f4b1906f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:07.565198 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-352bce09-437d-4105-90ff-c716f4b1906f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:07.566664 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-352bce09-437d-4105-90ff-c716f4b1906f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1407 microversion: 2.20 time: 0.297726 Sep 25 04:43:07.567975 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 434/809] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:43:07 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1407 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:43:08.288147 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell0:SELECT=6 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:43:08.293147 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-001a95b4-ebc5-4717-8995-753de5b409b1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:08.294006 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-001a95b4-ebc5-4717-8995-753de5b409b1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:08.301128 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-001a95b4-ebc5-4717-8995-753de5b409b1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:08.301980 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-001a95b4-ebc5-4717-8995-753de5b409b1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:08.302628 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-001a95b4-ebc5-4717-8995-753de5b409b1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:08.303495 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-001a95b4-ebc5-4717-8995-753de5b409b1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:08.304114 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-001a95b4-ebc5-4717-8995-753de5b409b1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:08.304722 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-001a95b4-ebc5-4717-8995-753de5b409b1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:08.309184 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:43:08.405853 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-001a95b4-ebc5-4717-8995-753de5b409b1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:08.414576 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-001a95b4-ebc5-4717-8995-753de5b409b1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 200 len: 1608 microversion: 2.1 time: 0.127198 Sep 25 04:43:08.415247 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 376/810] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:43:08 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 1608 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:43:08.595063 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-99b56156-6a31-4b1d-b19d-4e9b0b46e65d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:08.596567 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-99b56156-6a31-4b1d-b19d-4e9b0b46e65d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:08.611690 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-99b56156-6a31-4b1d-b19d-4e9b0b46e65d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:08.612181 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-99b56156-6a31-4b1d-b19d-4e9b0b46e65d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:08.612615 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-99b56156-6a31-4b1d-b19d-4e9b0b46e65d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:08.614623 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-99b56156-6a31-4b1d-b19d-4e9b0b46e65d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:08.615813 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-99b56156-6a31-4b1d-b19d-4e9b0b46e65d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:08.616286 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-99b56156-6a31-4b1d-b19d-4e9b0b46e65d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:08.978413 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [req-6352e0ad-a513-4621-beb8-86c581695f2f req-b7e41dc7-11af-4db1-b0af-8e6953636ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6582b313-e063-4d3f-940f-5ffba2370c65", "tag": "1a0b90ca-b310-46fa-adf6-563e2d00f49d"}]} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:43:08.988168 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-6352e0ad-a513-4621-beb8-86c581695f2f req-b7e41dc7-11af-4db1-b0af-8e6953636ed9 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:08.988932 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-6352e0ad-a513-4621-beb8-86c581695f2f req-b7e41dc7-11af-4db1-b0af-8e6953636ed9 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:08.989361 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-6352e0ad-a513-4621-beb8-86c581695f2f req-b7e41dc7-11af-4db1-b0af-8e6953636ed9 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:09.000838 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.compute.server_external_events [req-6352e0ad-a513-4621-beb8-86c581695f2f req-b7e41dc7-11af-4db1-b0af-8e6953636ed9 service nova] Creating event network-changed:1a0b90ca-b310-46fa-adf6-563e2d00f49d for instance 6582b313-e063-4d3f-940f-5ffba2370c65 on hv-cinder-85535 Sep 25 04:43:09.006381 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [req-6352e0ad-a513-4621-beb8-86c581695f2f req-b7e41dc7-11af-4db1-b0af-8e6953636ed9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031827 Sep 25 04:43:09.006971 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 377/811] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 04:43:09.076605 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-795ccf13-8c74-49c9-9ac5-10f96c94e201 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:09.077682 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-795ccf13-8c74-49c9-9ac5-10f96c94e201 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:09.090066 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-795ccf13-8c74-49c9-9ac5-10f96c94e201 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:09.090569 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-795ccf13-8c74-49c9-9ac5-10f96c94e201 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:09.091011 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-795ccf13-8c74-49c9-9ac5-10f96c94e201 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:09.092542 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-795ccf13-8c74-49c9-9ac5-10f96c94e201 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:09.094940 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-795ccf13-8c74-49c9-9ac5-10f96c94e201 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:09.115109 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-795ccf13-8c74-49c9-9ac5-10f96c94e201 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:09.202968 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-99b56156-6a31-4b1d-b19d-4e9b0b46e65d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:09.220286 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-99b56156-6a31-4b1d-b19d-4e9b0b46e65d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:09.229755 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-99b56156-6a31-4b1d-b19d-4e9b0b46e65d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:09.232931 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-99b56156-6a31-4b1d-b19d-4e9b0b46e65d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1407 microversion: 2.20 time: 0.642099 Sep 25 04:43:09.236198 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 435/812] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:43:08 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1407 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:43:09.275842 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.objects.instance [None req-795ccf13-8c74-49c9-9ac5-10f96c94e201 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lazy-loading 'services' on Instance uuid 6582b313-e063-4d3f-940f-5ffba2370c65 {{(pid=127141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 04:43:09.435357 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-795ccf13-8c74-49c9-9ac5-10f96c94e201 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65/os-volume_attachments/8a1f5b3d-cbb6-48a8-a71d-6a17ad8c853c" status: 202 len: 0 microversion: 2.1 time: 0.365662 Sep 25 04:43:09.439410 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 378/813] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Sep 25 04:43:09 2022] DELETE /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65/os-volume_attachments/8a1f5b3d-cbb6-48a8-a71d-6a17ad8c853c => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 04:43:09.443212 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-1b06bad1-33fb-4235-86cc-2f986c0d0982 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:09.444032 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-1b06bad1-33fb-4235-86cc-2f986c0d0982 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:09.450976 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-631f701a-4c83-4748-a972-e4beceec846b tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:09.462103 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-631f701a-4c83-4748-a972-e4beceec846b tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:09.463714 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1b06bad1-33fb-4235-86cc-2f986c0d0982 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:09.465543 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1b06bad1-33fb-4235-86cc-2f986c0d0982 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:09.468382 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1b06bad1-33fb-4235-86cc-2f986c0d0982 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:09.469327 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1b06bad1-33fb-4235-86cc-2f986c0d0982 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:09.478589 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1b06bad1-33fb-4235-86cc-2f986c0d0982 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:09.481500 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1b06bad1-33fb-4235-86cc-2f986c0d0982 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:09.485284 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-631f701a-4c83-4748-a972-e4beceec846b tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:09.485797 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-631f701a-4c83-4748-a972-e4beceec846b tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:09.486243 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-631f701a-4c83-4748-a972-e4beceec846b tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:09.487115 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-631f701a-4c83-4748-a972-e4beceec846b tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:09.487579 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-631f701a-4c83-4748-a972-e4beceec846b tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:09.490821 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-631f701a-4c83-4748-a972-e4beceec846b tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:09.548960 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.wsgi [None req-1b06bad1-33fb-4235-86cc-2f986c0d0982 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] HTTP exception thrown: Instance c9be0143-7c91-4fba-8c2c-500f01573632 could not be found. Sep 25 04:43:09.551560 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-1b06bad1-33fb-4235-86cc-2f986c0d0982 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Request method failure captured: Sep 25 04:43:09.551560 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: request: GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 HTTP/1.1 Sep 25 04:43:09.551560 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept: application/json Sep 25 04:43:09.551560 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept-Encoding: identity Sep 25 04:43:09.551560 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Connection: close Sep 25 04:43:09.551560 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Length: 0 Sep 25 04:43:09.551560 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Type: application/json Sep 25 04:43:09.551560 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Host: 10.222.0.25 Sep 25 04:43:09.551560 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Openstack-System-Scope: None Sep 25 04:43:09.551560 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: User-Agent: python-urllib3/1.26.12 Sep 25 04:43:09.551560 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Auth-Token: gAAAAABjL9q7nf9z2AFWe_ZgBI9mzyxKi9FQqxumLn_xkX7-z7097abKZiB6SImy18K0VlZ6olkfGKNBx4S9VI7zNycXzxmkqoBg9SNojmCvkHbKCOn_KIkKAO9bMxiOq-1e9h_jM3ys4d9tw8bBJ8QetDHGpwZpsoOArig8XdzsteOkdzoX_JQ Sep 25 04:43:09.551560 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Id: None Sep 25 04:43:09.551560 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Name: None Sep 25 04:43:09.551560 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Identity-Status: Confirmed Sep 25 04:43:09.551560 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Is-Admin-Project: True Sep 25 04:43:09.551560 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Id: default Sep 25 04:43:09.551560 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Name: Default Sep 25 04:43:09.551560 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Id: e1108f4c9da246cb9b4b9f89833ceeda Sep 25 04:43:09.551560 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Name: tempest-AttachVolumeTestJSON-580125413 Sep 25 04:43:09.551560 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Role: reader,member Sep 25 04:43:09.551560 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Roles: reader,member Sep 25 04:43:09.553191 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e1108f4c9da246cb9b4b9f89833ceeda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e1108f4c9da246cb9b4b9f89833ceeda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e1108f4c9da246cb9b4b9f89833ceeda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e1108f4c9da246cb9b4b9f89833ceeda"}]}] Sep 25 04:43:09.553191 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant: tempest-AttachVolumeTestJSON-580125413 Sep 25 04:43:09.553191 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Id: e1108f4c9da246cb9b4b9f89833ceeda Sep 25 04:43:09.553191 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Name: tempest-AttachVolumeTestJSON-580125413 Sep 25 04:43:09.553191 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User: tempest-AttachVolumeTestJSON-580125413-project Sep 25 04:43:09.553191 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Id: default Sep 25 04:43:09.553191 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Name: Default Sep 25 04:43:09.553191 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Id: 16281c79f73e4063b52066966c393148 Sep 25 04:43:09.553191 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Name: tempest-AttachVolumeTestJSON-580125413-project Sep 25 04:43:09.553191 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: method: > Sep 25 04:43:09.553191 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: exception: Instance c9be0143-7c91-4fba-8c2c-500f01573632 could not be found. Sep 25 04:43:09.553191 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: action_args: {'id': 'c9be0143-7c91-4fba-8c2c-500f01573632'} Sep 25 04:43:09.554107 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:43:09.554107 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:43:09.554107 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:43:09.554107 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:43:09.554107 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:43:09.554107 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:43:09.554107 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:43:09.554107 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:43:09.554107 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:43:09.554107 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:43:09.554107 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9be0143-7c91-4fba-8c2c-500f01573632 could not be found. Sep 25 04:43:09.554107 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:43:09.554107 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:43:09.554107 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:43:09.554107 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:43:09.554107 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:43:09.554107 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:43:09.554107 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:43:09.554107 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:43:09.554107 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:43:09.555564 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:43:09.555564 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 04:43:09.555564 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 04:43:09.555564 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:43:09.555564 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:43:09.555564 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:43:09.555564 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:43:09.555564 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9be0143-7c91-4fba-8c2c-500f01573632 could not be found. Sep 25 04:43:09.555564 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:43:09.555564 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:43:09.555564 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:43:09.555564 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:43:09.555564 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:43:09.555564 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:43:09.555564 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:43:09.555564 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:43:09.555564 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9be0143-7c91-4fba-8c2c-500f01573632 could not be found. Sep 25 04:43:09.555564 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:43:09.566812 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-1b06bad1-33fb-4235-86cc-2f986c0d0982 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Returning 404 to user: Instance c9be0143-7c91-4fba-8c2c-500f01573632 could not be found. {{(pid=127142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:43:09.570210 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-1b06bad1-33fb-4235-86cc-2f986c0d0982 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 404 len: 111 microversion: 2.1 time: 0.134283 Sep 25 04:43:09.570643 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 436/814] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:43:09 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 04:43:09.602847 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-d395e6e7-0b38-4db4-81fc-7211a0c5d136 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '.version_select at 0x7f4d3eca89d0>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:09.604005 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-631f701a-4c83-4748-a972-e4beceec846b tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161973 Sep 25 04:43:09.605377 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 379/815] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 25 04:43:09 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:43:09.637869 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:43:09.680863 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-d395e6e7-0b38-4db4-81fc-7211a0c5d136 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2070930957" status: 202 len: 0 microversion: 2.1 time: 0.100727 Sep 25 04:43:09.686053 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 437/816] 10.222.0.25 () {58 vars in 1221 bytes} [Sun Sep 25 04:43:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2070930957 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 04:43:10.261784 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-e92fd227-f9c8-4ffb-8e9a-dd60c2c92beb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:10.262393 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-e92fd227-f9c8-4ffb-8e9a-dd60c2c92beb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:10.273174 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e92fd227-f9c8-4ffb-8e9a-dd60c2c92beb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:10.273321 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e92fd227-f9c8-4ffb-8e9a-dd60c2c92beb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:10.273746 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e92fd227-f9c8-4ffb-8e9a-dd60c2c92beb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:10.274643 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e92fd227-f9c8-4ffb-8e9a-dd60c2c92beb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:10.275102 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e92fd227-f9c8-4ffb-8e9a-dd60c2c92beb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:10.275548 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e92fd227-f9c8-4ffb-8e9a-dd60c2c92beb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:10.620969 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-77ce74ad-e71a-4e4d-a038-2d6780e593f7 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:10.624702 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-77ce74ad-e71a-4e4d-a038-2d6780e593f7 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:10.637570 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-e92fd227-f9c8-4ffb-8e9a-dd60c2c92beb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:10.657009 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-e92fd227-f9c8-4ffb-8e9a-dd60c2c92beb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:10.658754 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-77ce74ad-e71a-4e4d-a038-2d6780e593f7 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:10.659637 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-e92fd227-f9c8-4ffb-8e9a-dd60c2c92beb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:10.661906 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-e92fd227-f9c8-4ffb-8e9a-dd60c2c92beb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1407 microversion: 2.20 time: 0.403880 Sep 25 04:43:10.662560 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-77ce74ad-e71a-4e4d-a038-2d6780e593f7 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:10.662835 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 380/817] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:43:10 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1407 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:43:10.663400 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-77ce74ad-e71a-4e4d-a038-2d6780e593f7 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:10.667118 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-77ce74ad-e71a-4e4d-a038-2d6780e593f7 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:10.667732 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-77ce74ad-e71a-4e4d-a038-2d6780e593f7 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:10.668176 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-77ce74ad-e71a-4e4d-a038-2d6780e593f7 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:10.731396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-77ce74ad-e71a-4e4d-a038-2d6780e593f7 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.118030 Sep 25 04:43:10.732885 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 438/818] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 25 04:43:10 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65/os-volume_attachments => generated 25 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 04:43:10.745027 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-1a96480e-50a7-4eb7-8c0d-c0a042c42902 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:10.745772 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-1a96480e-50a7-4eb7-8c0d-c0a042c42902 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:10.756603 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1a96480e-50a7-4eb7-8c0d-c0a042c42902 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:10.757168 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1a96480e-50a7-4eb7-8c0d-c0a042c42902 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:10.757600 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1a96480e-50a7-4eb7-8c0d-c0a042c42902 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:10.761302 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1a96480e-50a7-4eb7-8c0d-c0a042c42902 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:10.762424 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1a96480e-50a7-4eb7-8c0d-c0a042c42902 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:10.763374 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1a96480e-50a7-4eb7-8c0d-c0a042c42902 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:10.871471 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-b5279bed-bbf9-465d-a6c3-afac1915ce64 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Action: 'create', calling method: .version_select at 0x7f4d3eca8160>, body: {"keypair": {"name": "tempest-keypair-33596097", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhcL8X8QTNHBPaS3viJ/1XGXcY+iAjCLD8WQgLjCcNQeL2OerkRJFQHoc8zyojVPI0TDcx/QEkzot0h9U2cDa/QLEnnnmvjvyqBo1ta5qkC5sU+Z1eSl8s4JHPCLqz+kw=="}} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:43:10.891242 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.wsgi [None req-1a96480e-50a7-4eb7-8c0d-c0a042c42902 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] HTTP exception thrown: Instance 6582b313-e063-4d3f-940f-5ffba2370c65 is not attached to volume 8a1f5b3d-cbb6-48a8-a71d-6a17ad8c853c Sep 25 04:43:10.891420 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.quota [None req-b5279bed-bbf9-465d-a6c3-afac1915ce64 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Getting quotas for project e1108f4c9da246cb9b4b9f89833ceeda. Resources: {'key_pairs'} {{(pid=127142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 04:43:10.893656 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-1a96480e-50a7-4eb7-8c0d-c0a042c42902 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Request method failure captured: Sep 25 04:43:10.893656 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: request: DELETE /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65/os-volume_attachments/8a1f5b3d-cbb6-48a8-a71d-6a17ad8c853c HTTP/1.1 Sep 25 04:43:10.893656 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept: application/json Sep 25 04:43:10.893656 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept-Encoding: identity Sep 25 04:43:10.893656 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Connection: close Sep 25 04:43:10.893656 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Length: 0 Sep 25 04:43:10.893656 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Type: application/json Sep 25 04:43:10.893656 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Host: 10.222.0.25 Sep 25 04:43:10.893656 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Openstack-System-Scope: None Sep 25 04:43:10.893656 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: User-Agent: python-urllib3/1.26.12 Sep 25 04:43:10.893656 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Auth-Token: gAAAAABjL9tVQfLcYo0VqwoKqDDRYq7Jtazig_4SAVhsb4boxfnCtntSAWvNBIZR4M58IoaH-aDXgXRLs9VZqTCOBB7080JCKqk3rj1ppwTQ0x7pljVLdE2l02ETjK2cX5fAxEh-nplZTDnti0IBprkWdZNXn-MxgbJV42JGOe1rVQv8OoiIS6I Sep 25 04:43:10.893656 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Id: None Sep 25 04:43:10.893656 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Name: None Sep 25 04:43:10.893656 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Identity-Status: Confirmed Sep 25 04:43:10.893656 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Is-Admin-Project: True Sep 25 04:43:10.893656 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Id: default Sep 25 04:43:10.893656 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Name: Default Sep 25 04:43:10.893656 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Id: b5c1180472fb4243bd45e44914a46918 Sep 25 04:43:10.893656 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Name: tempest-TestMinimumBasicScenario-550568109 Sep 25 04:43:10.893656 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Role: reader,member Sep 25 04:43:10.893656 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Roles: reader,member Sep 25 04:43:10.895094 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b5c1180472fb4243bd45e44914a46918"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b5c1180472fb4243bd45e44914a46918"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b5c1180472fb4243bd45e44914a46918"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b5c1180472fb4243bd45e44914a46918"}]}] Sep 25 04:43:10.895094 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant: tempest-TestMinimumBasicScenario-550568109 Sep 25 04:43:10.895094 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Id: b5c1180472fb4243bd45e44914a46918 Sep 25 04:43:10.895094 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Name: tempest-TestMinimumBasicScenario-550568109 Sep 25 04:43:10.895094 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User: tempest-TestMinimumBasicScenario-550568109-project Sep 25 04:43:10.895094 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Id: default Sep 25 04:43:10.895094 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Name: Default Sep 25 04:43:10.895094 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Id: 5902801c596048389599b2b18df16dd4 Sep 25 04:43:10.895094 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Name: tempest-TestMinimumBasicScenario-550568109-project Sep 25 04:43:10.895094 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: method: > Sep 25 04:43:10.895094 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: exception: Instance 6582b313-e063-4d3f-940f-5ffba2370c65 is not attached to volume 8a1f5b3d-cbb6-48a8-a71d-6a17ad8c853c Sep 25 04:43:10.895812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: action_args: {'server_id': '6582b313-e063-4d3f-940f-5ffba2370c65', 'id': '8a1f5b3d-cbb6-48a8-a71d-6a17ad8c853c'} Sep 25 04:43:10.895812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:43:10.895812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:43:10.895812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 25 04:43:10.895812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 25 04:43:10.895812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 04:43:10.895812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 04:43:10.895812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 25 04:43:10.895812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 25 04:43:10.895812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8a1f5b3d-cbb6-48a8-a71d-6a17ad8c853c. Sep 25 04:43:10.895812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:43:10.895812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:43:10.895812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:43:10.895812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:43:10.895812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:43:10.895812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:43:10.895812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:43:10.895812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:43:10.895812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:43:10.897163 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:43:10.897163 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 25 04:43:10.897163 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 25 04:43:10.897163 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6582b313-e063-4d3f-940f-5ffba2370c65 is not attached to volume 8a1f5b3d-cbb6-48a8-a71d-6a17ad8c853c Sep 25 04:43:10.897163 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:43:10.897163 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:43:10.897163 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:43:10.897163 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:43:10.897163 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:43:10.897163 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:43:10.897163 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:43:10.897163 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:43:10.897163 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6582b313-e063-4d3f-940f-5ffba2370c65 is not attached to volume 8a1f5b3d-cbb6-48a8-a71d-6a17ad8c853c Sep 25 04:43:10.897163 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:43:10.897163 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-1a96480e-50a7-4eb7-8c0d-c0a042c42902 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Returning 404 to user: Instance 6582b313-e063-4d3f-940f-5ffba2370c65 is not attached to volume 8a1f5b3d-cbb6-48a8-a71d-6a17ad8c853c {{(pid=127141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:43:10.898162 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-1a96480e-50a7-4eb7-8c0d-c0a042c42902 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65/os-volume_attachments/8a1f5b3d-cbb6-48a8-a71d-6a17ad8c853c" status: 404 len: 154 microversion: 2.1 time: 0.154507 Sep 25 04:43:10.898251 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.quota [None req-b5279bed-bbf9-465d-a6c3-afac1915ce64 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Getting quotas for user 16281c79f73e4063b52066966c393148 and project e1108f4c9da246cb9b4b9f89833ceeda. Resources: {'key_pairs'} {{(pid=127142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 04:43:10.898345 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 381/819] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Sep 25 04:43:10 2022] DELETE /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65/os-volume_attachments/8a1f5b3d-cbb6-48a8-a71d-6a17ad8c853c => generated 154 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 04:43:10.922345 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-b5279bed-bbf9-465d-a6c3-afac1915ce64 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.054714 Sep 25 04:43:10.923617 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 439/820] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 25 04:43:10 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:43:11.026796 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [req-f7aa2cfb-a647-4b9e-8e68-116ae56cc4e4 req-f8efa5a7-b6ab-411d-b66e-58a239f4d88a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6582b313-e063-4d3f-940f-5ffba2370c65", "tag": "1a0b90ca-b310-46fa-adf6-563e2d00f49d"}]} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:43:11.041030 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-f7aa2cfb-a647-4b9e-8e68-116ae56cc4e4 req-f8efa5a7-b6ab-411d-b66e-58a239f4d88a service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:11.041518 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-f7aa2cfb-a647-4b9e-8e68-116ae56cc4e4 req-f8efa5a7-b6ab-411d-b66e-58a239f4d88a service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:11.042448 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-f7aa2cfb-a647-4b9e-8e68-116ae56cc4e4 req-f8efa5a7-b6ab-411d-b66e-58a239f4d88a service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:11.058600 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.compute.server_external_events [req-f7aa2cfb-a647-4b9e-8e68-116ae56cc4e4 req-f8efa5a7-b6ab-411d-b66e-58a239f4d88a service nova] Creating event network-changed:1a0b90ca-b310-46fa-adf6-563e2d00f49d for instance 6582b313-e063-4d3f-940f-5ffba2370c65 on hv-cinder-85535 Sep 25 04:43:11.064040 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [req-f7aa2cfb-a647-4b9e-8e68-116ae56cc4e4 req-f8efa5a7-b6ab-411d-b66e-58a239f4d88a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042657 Sep 25 04:43:11.064618 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 382/821] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:43:11.349601 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-2bc9628f-7031-48ea-bf0c-fa5c2e2456fb tempest-VolumesGetTestJSON-360626860 tempest-VolumesGetTestJSON-360626860-project] Action: 'create', calling method: .version_select at 0x7f4d3eca75e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-871671608", "metadata": {"Type": "work"}}} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:43:11.694297 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-77aaca65-9587-42d9-82fe-9efce17ebc2f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:11.696208 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-77aaca65-9587-42d9-82fe-9efce17ebc2f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:11.706187 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-77aaca65-9587-42d9-82fe-9efce17ebc2f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:11.707396 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-77aaca65-9587-42d9-82fe-9efce17ebc2f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:11.708038 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-77aaca65-9587-42d9-82fe-9efce17ebc2f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:11.708994 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-77aaca65-9587-42d9-82fe-9efce17ebc2f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:11.710607 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-77aaca65-9587-42d9-82fe-9efce17ebc2f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:11.711620 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-77aaca65-9587-42d9-82fe-9efce17ebc2f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:11.730963 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-2bc9628f-7031-48ea-bf0c-fa5c2e2456fb tempest-VolumesGetTestJSON-360626860 tempest-VolumesGetTestJSON-360626860-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.506410 Sep 25 04:43:11.732924 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 440/822] 10.222.0.25 () {60 vars in 1156 bytes} [Sun Sep 25 04:43:11 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 509 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 25 04:43:11.747579 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-8edb9463-7a69-42d9-839a-c2cff3e0b1f2 tempest-VolumesGetTestJSON-360626860 tempest-VolumesGetTestJSON-360626860-project] Calling method '.version_select at 0x7f4d3eb5ed30>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:11.828017 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-8edb9463-7a69-42d9-839a-c2cff3e0b1f2 tempest-VolumesGetTestJSON-360626860 tempest-VolumesGetTestJSON-360626860-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e7146057-7817-46e4-83a3-5468ac4ffeae" status: 200 len: 352 microversion: 2.1 time: 0.084692 Sep 25 04:43:11.828608 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 441/823] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Sep 25 04:43:11 2022] GET /compute/v2.1/os-volumes/e7146057-7817-46e4-83a3-5468ac4ffeae => generated 352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 04:43:11.934235 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-77aaca65-9587-42d9-82fe-9efce17ebc2f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:11.943885 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-77aaca65-9587-42d9-82fe-9efce17ebc2f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:11.945365 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-77aaca65-9587-42d9-82fe-9efce17ebc2f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:11.946483 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-77aaca65-9587-42d9-82fe-9efce17ebc2f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1407 microversion: 2.20 time: 0.258272 Sep 25 04:43:11.947231 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 383/824] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:43:11 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1407 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:43:11.995719 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-934a22b2-733c-4de0-8ccd-099ca8489c90 req-b37e7a84-2f75-45c5-bcdf-9971b138281f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ae04d96-b4dc-4acf-9f79-4f6644c1a082", "name": "network-vif-plugged", "status": "completed", "tag": "67e59d38-b12f-4f51-bb79-591d93062336"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:43:12.007274 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-934a22b2-733c-4de0-8ccd-099ca8489c90 req-b37e7a84-2f75-45c5-bcdf-9971b138281f service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:12.018999 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-934a22b2-733c-4de0-8ccd-099ca8489c90 req-b37e7a84-2f75-45c5-bcdf-9971b138281f service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:12.019896 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-934a22b2-733c-4de0-8ccd-099ca8489c90 req-b37e7a84-2f75-45c5-bcdf-9971b138281f service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:12.038939 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-934a22b2-733c-4de0-8ccd-099ca8489c90 req-b37e7a84-2f75-45c5-bcdf-9971b138281f service nova] Creating event network-vif-plugged:67e59d38-b12f-4f51-bb79-591d93062336 for instance 8ae04d96-b4dc-4acf-9f79-4f6644c1a082 on hv-cinder-85535 Sep 25 04:43:12.045284 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-934a22b2-733c-4de0-8ccd-099ca8489c90 req-b37e7a84-2f75-45c5-bcdf-9971b138281f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053131 Sep 25 04:43:12.045941 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 442/825] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:43:12.116833 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-d89a756e-25b6-4555-abde-138090e21050 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:12.117362 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-d89a756e-25b6-4555-abde-138090e21050 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:12.123771 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d89a756e-25b6-4555-abde-138090e21050 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:12.124201 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d89a756e-25b6-4555-abde-138090e21050 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:12.124662 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d89a756e-25b6-4555-abde-138090e21050 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:12.125391 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d89a756e-25b6-4555-abde-138090e21050 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:12.125881 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d89a756e-25b6-4555-abde-138090e21050 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:12.126336 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d89a756e-25b6-4555-abde-138090e21050 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:12.152526 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-d89a756e-25b6-4555-abde-138090e21050 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Going to try to terminate instance {{(pid=127141) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 04:43:12.233685 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:43:12.243092 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-d89a756e-25b6-4555-abde-138090e21050 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 204 len: 0 microversion: 2.1 time: 0.140235 Sep 25 04:43:12.244149 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 384/826] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 25 04:43:12 2022] DELETE /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 04:43:12.252831 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-7f2197de-be4c-40f3-ac00-287fc59d5395 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:12.253699 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-7f2197de-be4c-40f3-ac00-287fc59d5395 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:12.260317 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7f2197de-be4c-40f3-ac00-287fc59d5395 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:12.260912 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7f2197de-be4c-40f3-ac00-287fc59d5395 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:12.261409 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7f2197de-be4c-40f3-ac00-287fc59d5395 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:12.262195 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7f2197de-be4c-40f3-ac00-287fc59d5395 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:12.262714 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7f2197de-be4c-40f3-ac00-287fc59d5395 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:12.263203 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7f2197de-be4c-40f3-ac00-287fc59d5395 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:12.399632 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-7f2197de-be4c-40f3-ac00-287fc59d5395 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:12.407439 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-7f2197de-be4c-40f3-ac00-287fc59d5395 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1554 microversion: 2.1 time: 0.159014 Sep 25 04:43:12.408017 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 443/827] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:43:12 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:43:12.556068 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-adba1854-91e8-4cdd-9ce1-e6704e4a5008 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-33852260", "imageRef": "e5cfdbb2-d0ce-4736-b311-1a3c155844e9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "10349c1a-2a69-4296-a276-3606a4c13086"}], "security_groups": [{"name": "tempest-securitygroup--62629441"}], "key_name": "tempest-keypair-33596097", "user_data": "}} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:43:12.661788 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.network.neutron [None req-adba1854-91e8-4cdd-9ce1-e6704e4a5008 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] validate_networks() for [('10349c1a-2a69-4296-a276-3606a4c13086', None, None, None, None, None)] {{(pid=127141) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 04:43:12.842413 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-85830bdf-b810-4851-bc50-041d5bc297a1 tempest-VolumesGetTestJSON-360626860 tempest-VolumesGetTestJSON-360626860-project] Calling method '.version_select at 0x7f4d3eced9d0>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:12.890948 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-85830bdf-b810-4851-bc50-041d5bc297a1 tempest-VolumesGetTestJSON-360626860 tempest-VolumesGetTestJSON-360626860-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e7146057-7817-46e4-83a3-5468ac4ffeae" status: 200 len: 353 microversion: 2.1 time: 0.052373 Sep 25 04:43:12.891622 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 444/828] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Sep 25 04:43:12 2022] GET /compute/v2.1/os-volumes/e7146057-7817-46e4-83a3-5468ac4ffeae => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 04:43:12.905100 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-deb21be5-f11e-4eb2-b638-bb786662d87a tempest-VolumesGetTestJSON-360626860 tempest-VolumesGetTestJSON-360626860-project] Calling method '.version_select at 0x7f4d3eb31550>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:12.958457 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-deb21be5-f11e-4eb2-b638-bb786662d87a tempest-VolumesGetTestJSON-360626860 tempest-VolumesGetTestJSON-360626860-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e7146057-7817-46e4-83a3-5468ac4ffeae" status: 200 len: 353 microversion: 2.1 time: 0.056839 Sep 25 04:43:12.959117 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 445/829] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Sep 25 04:43:12 2022] GET /compute/v2.1/os-volumes/e7146057-7817-46e4-83a3-5468ac4ffeae => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 04:43:12.973096 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-0142c8fd-4e09-4655-8037-3a5349597cfc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:12.973818 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-0142c8fd-4e09-4655-8037-3a5349597cfc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:12.980526 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0142c8fd-4e09-4655-8037-3a5349597cfc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:12.981105 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0142c8fd-4e09-4655-8037-3a5349597cfc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:12.981542 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0142c8fd-4e09-4655-8037-3a5349597cfc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:12.982246 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0142c8fd-4e09-4655-8037-3a5349597cfc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:12.982680 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0142c8fd-4e09-4655-8037-3a5349597cfc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:12.983101 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0142c8fd-4e09-4655-8037-3a5349597cfc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:13.189311 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-0142c8fd-4e09-4655-8037-3a5349597cfc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:13.198828 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-0142c8fd-4e09-4655-8037-3a5349597cfc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:13.200271 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-0142c8fd-4e09-4655-8037-3a5349597cfc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:13.201430 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-0142c8fd-4e09-4655-8037-3a5349597cfc tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1407 microversion: 2.20 time: 0.233136 Sep 25 04:43:13.201996 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 446/830] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:43:12 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:43:13.206589 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-e243e97f-fac9-4338-a5e2-a6292a06c740 tempest-VolumesGetTestJSON-360626860 tempest-VolumesGetTestJSON-360626860-project] Calling method '.version_select at 0x7f4d3eb20dc0>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:13.217065 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-adba1854-91e8-4cdd-9ce1-e6704e4a5008 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Flavor limits 0:0:0 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 04:43:13.217542 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-adba1854-91e8-4cdd-9ce1-e6704e4a5008 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Image limits 0:0:0 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 04:43:13.217942 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-adba1854-91e8-4cdd-9ce1-e6704e4a5008 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Flavor pref 0:0:0 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 04:43:13.218364 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-adba1854-91e8-4cdd-9ce1-e6704e4a5008 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Image pref 0:0:0 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 04:43:13.218770 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-adba1854-91e8-4cdd-9ce1-e6704e4a5008 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 04:43:13.228098 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-adba1854-91e8-4cdd-9ce1-e6704e4a5008 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:13.228578 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-adba1854-91e8-4cdd-9ce1-e6704e4a5008 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:13.229049 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-adba1854-91e8-4cdd-9ce1-e6704e4a5008 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:13.229770 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-adba1854-91e8-4cdd-9ce1-e6704e4a5008 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:13.230231 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-adba1854-91e8-4cdd-9ce1-e6704e4a5008 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:13.230642 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-adba1854-91e8-4cdd-9ce1-e6704e4a5008 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:13.247834 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.quota [None req-adba1854-91e8-4cdd-9ce1-e6704e4a5008 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Getting quotas for project e1108f4c9da246cb9b4b9f89833ceeda. Resources: {'instances', 'ram', 'cores'} {{(pid=127141) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 04:43:13.252273 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.quota [None req-adba1854-91e8-4cdd-9ce1-e6704e4a5008 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Getting quotas for user 16281c79f73e4063b52066966c393148 and project e1108f4c9da246cb9b4b9f89833ceeda. Resources: {'instances', 'ram', 'cores'} {{(pid=127141) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 04:43:13.264925 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-adba1854-91e8-4cdd-9ce1-e6704e4a5008 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Going to run 1 instances... {{(pid=127141) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 04:43:13.267606 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-adba1854-91e8-4cdd-9ce1-e6704e4a5008 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: ffac6eac-431f-426a-9819-d3a16eebbd6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5cfdbb2-d0ce-4736-b311-1a3c155844e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127141) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 04:43:13.271840 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-e243e97f-fac9-4338-a5e2-a6292a06c740 tempest-VolumesGetTestJSON-360626860 tempest-VolumesGetTestJSON-360626860-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/e7146057-7817-46e4-83a3-5468ac4ffeae" status: 202 len: 0 microversion: 2.1 time: 0.068643 Sep 25 04:43:13.272412 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 447/831] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Sep 25 04:43:13 2022] DELETE /compute/v2.1/os-volumes/e7146057-7817-46e4-83a3-5468ac4ffeae => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 04:43:13.279971 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-8aee6fbe-aada-4fd1-b75d-9405ff008064 tempest-VolumesGetTestJSON-360626860 tempest-VolumesGetTestJSON-360626860-project] Calling method '.version_select at 0x7f4d3eb20040>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:13.317331 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR oslo.messaging._drivers.impl_rabbit [None req-adba1854-91e8-4cdd-9ce1-e6704e4a5008 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [aca267f7-a1dd-46f2-8d49-ab6d58681eed] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 25 04:43:13.329783 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-8aee6fbe-aada-4fd1-b75d-9405ff008064 tempest-VolumesGetTestJSON-360626860 tempest-VolumesGetTestJSON-360626860-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e7146057-7817-46e4-83a3-5468ac4ffeae" status: 200 len: 352 microversion: 2.1 time: 0.053293 Sep 25 04:43:13.330351 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 448/832] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Sep 25 04:43:13 2022] GET /compute/v2.1/os-volumes/e7146057-7817-46e4-83a3-5468ac4ffeae => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 04:43:13.431129 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-d72efbcc-4988-42d7-b9a8-3b116fd57a38 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:13.431769 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-d72efbcc-4988-42d7-b9a8-3b116fd57a38 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:13.438464 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d72efbcc-4988-42d7-b9a8-3b116fd57a38 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:13.438896 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d72efbcc-4988-42d7-b9a8-3b116fd57a38 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:13.439338 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d72efbcc-4988-42d7-b9a8-3b116fd57a38 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:13.440031 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d72efbcc-4988-42d7-b9a8-3b116fd57a38 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:13.440490 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d72efbcc-4988-42d7-b9a8-3b116fd57a38 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:13.440946 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d72efbcc-4988-42d7-b9a8-3b116fd57a38 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:13.571234 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-d72efbcc-4988-42d7-b9a8-3b116fd57a38 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:13.579158 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-d72efbcc-4988-42d7-b9a8-3b116fd57a38 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1554 microversion: 2.1 time: 0.151753 Sep 25 04:43:13.579721 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 449/833] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:43:13 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:43:14.228986 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-e4067469-3e33-4c02-8d5c-11081fe7e850 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:14.229607 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-e4067469-3e33-4c02-8d5c-11081fe7e850 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:14.235898 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e4067469-3e33-4c02-8d5c-11081fe7e850 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:14.236380 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e4067469-3e33-4c02-8d5c-11081fe7e850 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:14.236853 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e4067469-3e33-4c02-8d5c-11081fe7e850 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:14.237538 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e4067469-3e33-4c02-8d5c-11081fe7e850 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:14.238658 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e4067469-3e33-4c02-8d5c-11081fe7e850 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:14.239216 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e4067469-3e33-4c02-8d5c-11081fe7e850 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:14.324406 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO oslo.messaging._drivers.impl_rabbit [None req-adba1854-91e8-4cdd-9ce1-e6704e4a5008 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [aca267f7-a1dd-46f2-8d49-ab6d58681eed] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 40668. Sep 25 04:43:14.328311 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-adba1854-91e8-4cdd-9ce1-e6704e4a5008 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.777704 Sep 25 04:43:14.329274 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 385/834] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 25 04:43:12 2022] POST /compute/v2.1/servers => generated 400 bytes in 1779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 04:43:14.341835 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-c6f9bb48-b2a4-4cf1-be92-a6e2134366c1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:14.342638 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-c6f9bb48-b2a4-4cf1-be92-a6e2134366c1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: ffac6eac-431f-426a-9819-d3a16eebbd6e] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:14.382336 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-e4067469-3e33-4c02-8d5c-11081fe7e850 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:14.391358 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-e4067469-3e33-4c02-8d5c-11081fe7e850 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:14.392927 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-e4067469-3e33-4c02-8d5c-11081fe7e850 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:14.394105 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-e4067469-3e33-4c02-8d5c-11081fe7e850 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1407 microversion: 2.20 time: 0.169181 Sep 25 04:43:14.395750 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 450/835] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:43:14 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 04:43:14.400597 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-d1633e90-2575-48ad-a8c0-db7b3a2d9c8d tempest-VolumesGetTestJSON-360626860 tempest-VolumesGetTestJSON-360626860-project] Calling method '.version_select at 0x7f4d3eb5f550>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:14.405162 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-c6f9bb48-b2a4-4cf1-be92-a6e2134366c1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:14.414599 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-c6f9bb48-b2a4-4cf1-be92-a6e2134366c1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e" status: 200 len: 1234 microversion: 2.1 time: 0.077115 Sep 25 04:43:14.415453 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 386/836] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:43:14 2022] GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e => generated 1234 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:43:14.433288 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.wsgi [None req-d1633e90-2575-48ad-a8c0-db7b3a2d9c8d tempest-VolumesGetTestJSON-360626860 tempest-VolumesGetTestJSON-360626860-project] HTTP exception thrown: Volume e7146057-7817-46e4-83a3-5468ac4ffeae could not be found. Sep 25 04:43:14.436707 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-d1633e90-2575-48ad-a8c0-db7b3a2d9c8d tempest-VolumesGetTestJSON-360626860 tempest-VolumesGetTestJSON-360626860-project] Request method failure captured: Sep 25 04:43:14.436707 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: request: GET /compute/v2.1/os-volumes/e7146057-7817-46e4-83a3-5468ac4ffeae HTTP/1.1 Sep 25 04:43:14.436707 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept: application/json Sep 25 04:43:14.436707 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept-Encoding: identity Sep 25 04:43:14.436707 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Connection: close Sep 25 04:43:14.436707 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Length: 0 Sep 25 04:43:14.436707 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Type: application/json Sep 25 04:43:14.436707 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Host: 10.222.0.25 Sep 25 04:43:14.436707 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Openstack-System-Scope: None Sep 25 04:43:14.436707 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: User-Agent: python-urllib3/1.26.12 Sep 25 04:43:14.436707 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Auth-Token: gAAAAABjL9xfT5mmOfSIHQ6VYUNYrUm-52N95aBgUkCyCCPrH1WeqMgtXF3hFqazH3kod91l4QxjjSwtv1N56Jdu2KZSXr7EzL4i9Kz-_2ydvA-f0kriGTVNilcCCng1OUOYHUul5sGHmEWzwSVloPE92RhAyT2AQHIU2GCHnBlxa8QYynB_JnQ Sep 25 04:43:14.436707 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Id: None Sep 25 04:43:14.436707 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Name: None Sep 25 04:43:14.436707 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Identity-Status: Confirmed Sep 25 04:43:14.436707 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Is-Admin-Project: True Sep 25 04:43:14.436707 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Id: default Sep 25 04:43:14.436707 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Name: Default Sep 25 04:43:14.436707 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Id: d3f8a3c6dad64c04a37c1f1abe51d6b8 Sep 25 04:43:14.436707 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Name: tempest-VolumesGetTestJSON-360626860 Sep 25 04:43:14.436707 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Role: reader,member Sep 25 04:43:14.436707 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Roles: reader,member Sep 25 04:43:14.438325 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d3f8a3c6dad64c04a37c1f1abe51d6b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3f8a3c6dad64c04a37c1f1abe51d6b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3f8a3c6dad64c04a37c1f1abe51d6b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d3f8a3c6dad64c04a37c1f1abe51d6b8"}]}] Sep 25 04:43:14.438325 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant: tempest-VolumesGetTestJSON-360626860 Sep 25 04:43:14.438325 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Id: d3f8a3c6dad64c04a37c1f1abe51d6b8 Sep 25 04:43:14.438325 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Name: tempest-VolumesGetTestJSON-360626860 Sep 25 04:43:14.438325 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User: tempest-VolumesGetTestJSON-360626860-project Sep 25 04:43:14.438325 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Id: default Sep 25 04:43:14.438325 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Name: Default Sep 25 04:43:14.438325 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Id: a968a29f3730486aa8ebb9e1fd182470 Sep 25 04:43:14.438325 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Name: tempest-VolumesGetTestJSON-360626860-project Sep 25 04:43:14.438325 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: method: Sep 25 04:43:14.438325 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: exception: Volume e7146057-7817-46e4-83a3-5468ac4ffeae could not be found. Sep 25 04:43:14.438325 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: action_args: {'id': 'e7146057-7817-46e4-83a3-5468ac4ffeae'} Sep 25 04:43:14.438325 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:43:14.439255 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:43:14.439255 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 04:43:14.439255 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 04:43:14.439255 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 25 04:43:14.439255 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 25 04:43:14.439255 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 25 04:43:14.439255 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 25 04:43:14.439255 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 25 04:43:14.439255 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 25 04:43:14.439255 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 25 04:43:14.439255 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 25 04:43:14.439255 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 04:43:14.439255 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 04:43:14.439255 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 04:43:14.439255 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 04:43:14.439255 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e7146057-7817-46e4-83a3-5468ac4ffeae could not be found. (HTTP 404) (Request-ID: req-b1f8d0b2-525c-432a-a74d-36468fbdf530) Sep 25 04:43:14.439255 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:43:14.439255 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:43:14.439255 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:43:14.440664 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:43:14.440664 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 25 04:43:14.440664 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 25 04:43:14.440664 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 25 04:43:14.440664 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 25 04:43:14.440664 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 25 04:43:14.440664 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 25 04:43:14.440664 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 25 04:43:14.440664 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 25 04:43:14.440664 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 04:43:14.440664 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 04:43:14.440664 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 25 04:43:14.440664 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 25 04:43:14.440664 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 25 04:43:14.440664 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 25 04:43:14.440664 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 25 04:43:14.440664 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 25 04:43:14.440664 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 25 04:43:14.440664 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 25 04:43:14.442275 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 04:43:14.442275 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 04:43:14.442275 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 04:43:14.442275 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 04:43:14.442275 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e7146057-7817-46e4-83a3-5468ac4ffeae could not be found. Sep 25 04:43:14.442275 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:43:14.442275 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:43:14.442275 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:43:14.442275 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:43:14.442275 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:43:14.442275 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:43:14.442275 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:43:14.442275 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:43:14.442275 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 04:43:14.442275 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 04:43:14.442275 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:43:14.442275 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:43:14.442275 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 25 04:43:14.442275 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:43:14.444423 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e7146057-7817-46e4-83a3-5468ac4ffeae could not be found. Sep 25 04:43:14.444423 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:43:14.444423 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:43:14.444423 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:43:14.444423 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:43:14.444423 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:43:14.444423 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:43:14.444423 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:43:14.444423 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:43:14.444423 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e7146057-7817-46e4-83a3-5468ac4ffeae could not be found. Sep 25 04:43:14.444423 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:43:14.444423 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-d1633e90-2575-48ad-a8c0-db7b3a2d9c8d tempest-VolumesGetTestJSON-360626860 tempest-VolumesGetTestJSON-360626860-project] Returning 404 to user: Volume e7146057-7817-46e4-83a3-5468ac4ffeae could not be found. {{(pid=127142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:43:14.444423 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-d1633e90-2575-48ad-a8c0-db7b3a2d9c8d tempest-VolumesGetTestJSON-360626860 tempest-VolumesGetTestJSON-360626860-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e7146057-7817-46e4-83a3-5468ac4ffeae" status: 404 len: 109 microversion: 2.1 time: 0.041250 Sep 25 04:43:14.444423 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 451/837] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Sep 25 04:43:14 2022] GET /compute/v2.1/os-volumes/e7146057-7817-46e4-83a3-5468ac4ffeae => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 04:43:14.604666 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-a6fa9f15-1c61-4531-b5e0-eab82bac0062 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:14.605286 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-a6fa9f15-1c61-4531-b5e0-eab82bac0062 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:14.613733 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a6fa9f15-1c61-4531-b5e0-eab82bac0062 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:14.614728 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a6fa9f15-1c61-4531-b5e0-eab82bac0062 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:14.615312 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a6fa9f15-1c61-4531-b5e0-eab82bac0062 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:14.616139 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a6fa9f15-1c61-4531-b5e0-eab82bac0062 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:14.616692 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a6fa9f15-1c61-4531-b5e0-eab82bac0062 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:14.617409 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a6fa9f15-1c61-4531-b5e0-eab82bac0062 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:14.766307 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-a6fa9f15-1c61-4531-b5e0-eab82bac0062 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:14.774483 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-a6fa9f15-1c61-4531-b5e0-eab82bac0062 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1554 microversion: 2.1 time: 0.174910 Sep 25 04:43:14.775252 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 387/838] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:43:14 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1554 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:43:15.419740 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-63d16647-43e3-4489-bab7-3efe12f766c0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:15.420345 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-63d16647-43e3-4489-bab7-3efe12f766c0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:15.428219 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-63d16647-43e3-4489-bab7-3efe12f766c0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:15.428730 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-63d16647-43e3-4489-bab7-3efe12f766c0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:15.429165 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-63d16647-43e3-4489-bab7-3efe12f766c0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:15.429862 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-63d16647-43e3-4489-bab7-3efe12f766c0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:15.430307 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-63d16647-43e3-4489-bab7-3efe12f766c0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:15.430899 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-63d16647-43e3-4489-bab7-3efe12f766c0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:15.438378 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-451815b9-7721-45f1-93ea-ec4a4ab07862 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:15.439581 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-451815b9-7721-45f1-93ea-ec4a4ab07862 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: ffac6eac-431f-426a-9819-d3a16eebbd6e] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:15.451801 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-451815b9-7721-45f1-93ea-ec4a4ab07862 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:15.452602 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-451815b9-7721-45f1-93ea-ec4a4ab07862 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:15.453308 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-451815b9-7721-45f1-93ea-ec4a4ab07862 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:15.456494 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-451815b9-7721-45f1-93ea-ec4a4ab07862 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:15.457466 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-451815b9-7721-45f1-93ea-ec4a4ab07862 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:15.458333 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-451815b9-7721-45f1-93ea-ec4a4ab07862 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:15.599214 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-451815b9-7721-45f1-93ea-ec4a4ab07862 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:15.610322 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-451815b9-7721-45f1-93ea-ec4a4ab07862 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e" status: 200 len: 1230 microversion: 2.1 time: 0.176775 Sep 25 04:43:15.621865 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 388/839] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:43:15 2022] GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e => generated 1230 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:43:15.744820 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-63d16647-43e3-4489-bab7-3efe12f766c0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:15.755183 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-63d16647-43e3-4489-bab7-3efe12f766c0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:15.756911 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-63d16647-43e3-4489-bab7-3efe12f766c0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:15.758070 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-63d16647-43e3-4489-bab7-3efe12f766c0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1407 microversion: 2.20 time: 0.342697 Sep 25 04:43:15.758585 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 452/840] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:43:15 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1407 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:43:15.798591 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-d2fe56a5-e205-40f2-85f8-8ff91ac3183d tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:15.799106 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-d2fe56a5-e205-40f2-85f8-8ff91ac3183d tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:15.805774 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d2fe56a5-e205-40f2-85f8-8ff91ac3183d tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:15.806259 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d2fe56a5-e205-40f2-85f8-8ff91ac3183d tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:15.806879 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d2fe56a5-e205-40f2-85f8-8ff91ac3183d tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:15.807576 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d2fe56a5-e205-40f2-85f8-8ff91ac3183d tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:15.808026 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d2fe56a5-e205-40f2-85f8-8ff91ac3183d tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:15.808452 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d2fe56a5-e205-40f2-85f8-8ff91ac3183d tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:15.905698 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-d2fe56a5-e205-40f2-85f8-8ff91ac3183d tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:15.915349 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-d2fe56a5-e205-40f2-85f8-8ff91ac3183d tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1512 microversion: 2.1 time: 0.120592 Sep 25 04:43:15.925216 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 389/841] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:43:15 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1512 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:43:15.954573 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-c252ffe7-441d-4d87-8cbb-064f7dd104a7 req-f30acb11-601a-4546-8e5a-f21a39944d17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6582b313-e063-4d3f-940f-5ffba2370c65", "name": "network-vif-deleted", "tag": "1a0b90ca-b310-46fa-adf6-563e2d00f49d"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:43:15.966827 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-c252ffe7-441d-4d87-8cbb-064f7dd104a7 req-f30acb11-601a-4546-8e5a-f21a39944d17 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:15.967313 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-c252ffe7-441d-4d87-8cbb-064f7dd104a7 req-f30acb11-601a-4546-8e5a-f21a39944d17 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:15.967740 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-c252ffe7-441d-4d87-8cbb-064f7dd104a7 req-f30acb11-601a-4546-8e5a-f21a39944d17 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:15.979600 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-c252ffe7-441d-4d87-8cbb-064f7dd104a7 req-f30acb11-601a-4546-8e5a-f21a39944d17 service nova] Creating event network-vif-deleted:1a0b90ca-b310-46fa-adf6-563e2d00f49d for instance 6582b313-e063-4d3f-940f-5ffba2370c65 on hv-cinder-85535 Sep 25 04:43:15.984561 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-c252ffe7-441d-4d87-8cbb-064f7dd104a7 req-f30acb11-601a-4546-8e5a-f21a39944d17 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033746 Sep 25 04:43:15.985284 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 453/842] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:43:16.641039 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-0b452ceb-d5e1-49fc-9ff2-cea6bf7921d9 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:16.641703 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-0b452ceb-d5e1-49fc-9ff2-cea6bf7921d9 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: ffac6eac-431f-426a-9819-d3a16eebbd6e] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:16.657737 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0b452ceb-d5e1-49fc-9ff2-cea6bf7921d9 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:16.658481 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0b452ceb-d5e1-49fc-9ff2-cea6bf7921d9 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:16.662712 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0b452ceb-d5e1-49fc-9ff2-cea6bf7921d9 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:16.664025 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0b452ceb-d5e1-49fc-9ff2-cea6bf7921d9 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:16.665084 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0b452ceb-d5e1-49fc-9ff2-cea6bf7921d9 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:16.665674 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0b452ceb-d5e1-49fc-9ff2-cea6bf7921d9 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:16.784521 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-d274df8f-05bd-48b4-8bfd-bfc28306e463 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:16.786652 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-d274df8f-05bd-48b4-8bfd-bfc28306e463 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:16.793398 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d274df8f-05bd-48b4-8bfd-bfc28306e463 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:16.793878 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d274df8f-05bd-48b4-8bfd-bfc28306e463 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:16.795228 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d274df8f-05bd-48b4-8bfd-bfc28306e463 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:16.796514 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d274df8f-05bd-48b4-8bfd-bfc28306e463 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:16.797252 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d274df8f-05bd-48b4-8bfd-bfc28306e463 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:16.797878 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d274df8f-05bd-48b4-8bfd-bfc28306e463 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:16.807591 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-0b452ceb-d5e1-49fc-9ff2-cea6bf7921d9 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:16.827156 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-0b452ceb-d5e1-49fc-9ff2-cea6bf7921d9 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e" status: 200 len: 1294 microversion: 2.1 time: 0.195358 Sep 25 04:43:16.827731 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 390/843] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:43:16 2022] GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e => generated 1294 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:43:16.938659 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-e1987b2c-ec64-48ad-8d0f-8df945a3eeee tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:16.939268 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-e1987b2c-ec64-48ad-8d0f-8df945a3eeee tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:16.946260 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e1987b2c-ec64-48ad-8d0f-8df945a3eeee tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:16.946895 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e1987b2c-ec64-48ad-8d0f-8df945a3eeee tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:16.947351 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e1987b2c-ec64-48ad-8d0f-8df945a3eeee tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:16.948133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e1987b2c-ec64-48ad-8d0f-8df945a3eeee tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:16.948704 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e1987b2c-ec64-48ad-8d0f-8df945a3eeee tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:16.949100 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e1987b2c-ec64-48ad-8d0f-8df945a3eeee tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:16.988595 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e1987b2c-ec64-48ad-8d0f-8df945a3eeee tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:16.989268 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e1987b2c-ec64-48ad-8d0f-8df945a3eeee tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:16.989705 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e1987b2c-ec64-48ad-8d0f-8df945a3eeee tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:16.990154 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.objects.instance [None req-e1987b2c-ec64-48ad-8d0f-8df945a3eeee tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lazy-loading 'fault' on Instance uuid 6582b313-e063-4d3f-940f-5ffba2370c65 {{(pid=127141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 04:43:17.299798 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-e1987b2c-ec64-48ad-8d0f-8df945a3eeee tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902801c596048389599b2b18df16dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1180472fb4243bd45e44914a46918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:17.306358 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-d274df8f-05bd-48b4-8bfd-bfc28306e463 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:17.308337 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-e1987b2c-ec64-48ad-8d0f-8df945a3eeee tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 200 len: 1348 microversion: 2.1 time: 0.373573 Sep 25 04:43:17.308947 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 391/844] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:43:16 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 1348 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:43:17.330457 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-d274df8f-05bd-48b4-8bfd-bfc28306e463 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:17.332204 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-d274df8f-05bd-48b4-8bfd-bfc28306e463 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:17.333500 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-d274df8f-05bd-48b4-8bfd-bfc28306e463 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1599 microversion: 2.20 time: 0.553619 Sep 25 04:43:17.334180 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 454/845] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:43:16 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1599 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 04:43:17.358153 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-2438b817-702c-458b-98e2-e0e9e473f7b5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:17.358652 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-2438b817-702c-458b-98e2-e0e9e473f7b5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:17.365439 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2438b817-702c-458b-98e2-e0e9e473f7b5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:17.366195 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2438b817-702c-458b-98e2-e0e9e473f7b5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:17.366593 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2438b817-702c-458b-98e2-e0e9e473f7b5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:17.367306 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2438b817-702c-458b-98e2-e0e9e473f7b5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:17.367808 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2438b817-702c-458b-98e2-e0e9e473f7b5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:17.368412 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2438b817-702c-458b-98e2-e0e9e473f7b5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:17.471366 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-2438b817-702c-458b-98e2-e0e9e473f7b5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.117098 Sep 25 04:43:17.479273 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 392/846] 10.222.0.25 () {60 vars in 1316 bytes} [Sun Sep 25 04:43:17 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082/os-interface => generated 284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 04:43:17.864912 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-32a8905f-8470-4bc9-a63d-03e63a898379 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:17.868933 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-32a8905f-8470-4bc9-a63d-03e63a898379 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: ffac6eac-431f-426a-9819-d3a16eebbd6e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:17.886543 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-32a8905f-8470-4bc9-a63d-03e63a898379 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:17.887867 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-32a8905f-8470-4bc9-a63d-03e63a898379 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:17.888742 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-32a8905f-8470-4bc9-a63d-03e63a898379 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:17.889602 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-32a8905f-8470-4bc9-a63d-03e63a898379 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:17.890069 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-32a8905f-8470-4bc9-a63d-03e63a898379 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:17.890575 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-32a8905f-8470-4bc9-a63d-03e63a898379 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:18.153678 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-32a8905f-8470-4bc9-a63d-03e63a898379 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:18.168216 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-32a8905f-8470-4bc9-a63d-03e63a898379 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e" status: 200 len: 1358 microversion: 2.1 time: 0.313831 Sep 25 04:43:18.169671 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 455/847] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:43:17 2022] GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e => generated 1358 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:43:18.337954 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-8f73f65a-3116-4f39-992e-92073a5d4126 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:18.346278 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-8f73f65a-3116-4f39-992e-92073a5d4126 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] [instance: 6582b313-e063-4d3f-940f-5ffba2370c65] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:18.378043 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8f73f65a-3116-4f39-992e-92073a5d4126 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:18.379790 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8f73f65a-3116-4f39-992e-92073a5d4126 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:18.383217 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8f73f65a-3116-4f39-992e-92073a5d4126 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:18.390185 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8f73f65a-3116-4f39-992e-92073a5d4126 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:18.390897 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8f73f65a-3116-4f39-992e-92073a5d4126 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:18.391456 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8f73f65a-3116-4f39-992e-92073a5d4126 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:18.423076 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.wsgi [None req-8f73f65a-3116-4f39-992e-92073a5d4126 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] HTTP exception thrown: Instance 6582b313-e063-4d3f-940f-5ffba2370c65 could not be found. Sep 25 04:43:18.424848 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-8f73f65a-3116-4f39-992e-92073a5d4126 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Request method failure captured: Sep 25 04:43:18.424848 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: request: GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 HTTP/1.1 Sep 25 04:43:18.424848 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept: application/json Sep 25 04:43:18.424848 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept-Encoding: identity Sep 25 04:43:18.424848 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Connection: close Sep 25 04:43:18.424848 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Length: 0 Sep 25 04:43:18.424848 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Type: application/json Sep 25 04:43:18.424848 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Host: 10.222.0.25 Sep 25 04:43:18.424848 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Openstack-System-Scope: None Sep 25 04:43:18.424848 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: User-Agent: python-urllib3/1.26.12 Sep 25 04:43:18.424848 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Auth-Token: gAAAAABjL9tVQfLcYo0VqwoKqDDRYq7Jtazig_4SAVhsb4boxfnCtntSAWvNBIZR4M58IoaH-aDXgXRLs9VZqTCOBB7080JCKqk3rj1ppwTQ0x7pljVLdE2l02ETjK2cX5fAxEh-nplZTDnti0IBprkWdZNXn-MxgbJV42JGOe1rVQv8OoiIS6I Sep 25 04:43:18.424848 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Id: None Sep 25 04:43:18.424848 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Name: None Sep 25 04:43:18.424848 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Identity-Status: Confirmed Sep 25 04:43:18.424848 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Is-Admin-Project: True Sep 25 04:43:18.424848 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Id: default Sep 25 04:43:18.424848 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Name: Default Sep 25 04:43:18.424848 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Id: b5c1180472fb4243bd45e44914a46918 Sep 25 04:43:18.424848 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Name: tempest-TestMinimumBasicScenario-550568109 Sep 25 04:43:18.424848 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Role: reader,member Sep 25 04:43:18.424848 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Roles: reader,member Sep 25 04:43:18.427449 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b5c1180472fb4243bd45e44914a46918"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b5c1180472fb4243bd45e44914a46918"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b5c1180472fb4243bd45e44914a46918"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b5c1180472fb4243bd45e44914a46918"}]}] Sep 25 04:43:18.427449 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant: tempest-TestMinimumBasicScenario-550568109 Sep 25 04:43:18.427449 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Id: b5c1180472fb4243bd45e44914a46918 Sep 25 04:43:18.427449 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Name: tempest-TestMinimumBasicScenario-550568109 Sep 25 04:43:18.427449 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User: tempest-TestMinimumBasicScenario-550568109-project Sep 25 04:43:18.427449 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Id: default Sep 25 04:43:18.427449 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Name: Default Sep 25 04:43:18.427449 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Id: 5902801c596048389599b2b18df16dd4 Sep 25 04:43:18.427449 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Name: tempest-TestMinimumBasicScenario-550568109-project Sep 25 04:43:18.427449 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: method: > Sep 25 04:43:18.427449 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: exception: Instance 6582b313-e063-4d3f-940f-5ffba2370c65 could not be found. Sep 25 04:43:18.427449 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: action_args: {'id': '6582b313-e063-4d3f-940f-5ffba2370c65'} Sep 25 04:43:18.429131 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:43:18.429131 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:43:18.429131 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:43:18.429131 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:43:18.429131 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:43:18.429131 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:43:18.429131 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:43:18.429131 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:43:18.429131 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:43:18.429131 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:43:18.429131 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6582b313-e063-4d3f-940f-5ffba2370c65 could not be found. Sep 25 04:43:18.429131 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:43:18.429131 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:43:18.429131 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:43:18.429131 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:43:18.429131 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:43:18.429131 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:43:18.429131 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:43:18.429131 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:43:18.429131 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:43:18.431347 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:43:18.431347 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 04:43:18.431347 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 04:43:18.431347 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:43:18.431347 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:43:18.431347 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:43:18.431347 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:43:18.431347 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6582b313-e063-4d3f-940f-5ffba2370c65 could not be found. Sep 25 04:43:18.431347 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:43:18.431347 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:43:18.431347 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:43:18.431347 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:43:18.431347 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:43:18.431347 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:43:18.431347 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:43:18.431347 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:43:18.431347 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6582b313-e063-4d3f-940f-5ffba2370c65 could not be found. Sep 25 04:43:18.431347 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:43:18.432808 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-8f73f65a-3116-4f39-992e-92073a5d4126 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Returning 404 to user: Instance 6582b313-e063-4d3f-940f-5ffba2370c65 could not be found. {{(pid=127141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:43:18.432808 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-8f73f65a-3116-4f39-992e-92073a5d4126 tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65" status: 404 len: 111 microversion: 2.1 time: 0.099481 Sep 25 04:43:18.434079 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 393/848] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:43:18 2022] GET /compute/v2.1/servers/6582b313-e063-4d3f-940f-5ffba2370c65 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 04:43:18.440308 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-acd6f1d2-d401-4251-b41a-b498369af8ce tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] Calling method '.version_select at 0x7f4d3eb403a0>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:18.465894 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-acd6f1d2-d401-4251-b41a-b498369af8ce tempest-TestMinimumBasicScenario-550568109 tempest-TestMinimumBasicScenario-550568109-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-998201584" status: 202 len: 0 microversion: 2.1 time: 0.029534 Sep 25 04:43:18.467652 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 456/849] 10.222.0.25 () {58 vars in 1269 bytes} [Sun Sep 25 04:43:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-998201584 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 04:43:18.877711 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [req-7cf9c7f5-ce62-4016-8683-fa644f096347 req-06b011f8-ed75-41ec-b7c3-844a84053c43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffac6eac-431f-426a-9819-d3a16eebbd6e", "tag": "fe1a7c5e-cb1e-42df-9efe-1f8099bbc117"}]} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:43:18.881415 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-9c0010f1-44cc-4d20-8c3a-3fdcbb755d29 req-41926a82-e7a3-42e5-9888-bb2525cdb814 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ae04d96-b4dc-4acf-9f79-4f6644c1a082", "tag": "67e59d38-b12f-4f51-bb79-591d93062336"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:43:18.892563 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-7cf9c7f5-ce62-4016-8683-fa644f096347 req-06b011f8-ed75-41ec-b7c3-844a84053c43 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:18.893111 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-7cf9c7f5-ce62-4016-8683-fa644f096347 req-06b011f8-ed75-41ec-b7c3-844a84053c43 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:18.893895 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-7cf9c7f5-ce62-4016-8683-fa644f096347 req-06b011f8-ed75-41ec-b7c3-844a84053c43 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:18.905678 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-9c0010f1-44cc-4d20-8c3a-3fdcbb755d29 req-41926a82-e7a3-42e5-9888-bb2525cdb814 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:18.906179 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-9c0010f1-44cc-4d20-8c3a-3fdcbb755d29 req-41926a82-e7a3-42e5-9888-bb2525cdb814 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:18.906617 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-9c0010f1-44cc-4d20-8c3a-3fdcbb755d29 req-41926a82-e7a3-42e5-9888-bb2525cdb814 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:18.912419 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:43:18.915274 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.compute.server_external_events [req-7cf9c7f5-ce62-4016-8683-fa644f096347 req-06b011f8-ed75-41ec-b7c3-844a84053c43 service nova] Creating event network-changed:fe1a7c5e-cb1e-42df-9efe-1f8099bbc117 for instance ffac6eac-431f-426a-9819-d3a16eebbd6e on hv-cinder-85535 Sep 25 04:43:18.935184 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [req-7cf9c7f5-ce62-4016-8683-fa644f096347 req-06b011f8-ed75-41ec-b7c3-844a84053c43 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072735 Sep 25 04:43:18.936558 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 394/850] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:43:18.940728 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-9c0010f1-44cc-4d20-8c3a-3fdcbb755d29 req-41926a82-e7a3-42e5-9888-bb2525cdb814 service nova] Creating event network-changed:67e59d38-b12f-4f51-bb79-591d93062336 for instance 8ae04d96-b4dc-4acf-9f79-4f6644c1a082 on hv-cinder-85535 Sep 25 04:43:18.947288 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-9c0010f1-44cc-4d20-8c3a-3fdcbb755d29 req-41926a82-e7a3-42e5-9888-bb2525cdb814 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074073 Sep 25 04:43:18.947879 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 457/851] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:43:19.197671 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-3c05dae6-e6c3-4841-97e5-683b3669c34f tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:19.198717 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-3c05dae6-e6c3-4841-97e5-683b3669c34f tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: ffac6eac-431f-426a-9819-d3a16eebbd6e] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:19.209214 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3c05dae6-e6c3-4841-97e5-683b3669c34f tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:19.210794 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3c05dae6-e6c3-4841-97e5-683b3669c34f tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:19.211649 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3c05dae6-e6c3-4841-97e5-683b3669c34f tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:19.213165 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3c05dae6-e6c3-4841-97e5-683b3669c34f tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:19.213883 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3c05dae6-e6c3-4841-97e5-683b3669c34f tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:19.220923 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3c05dae6-e6c3-4841-97e5-683b3669c34f tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:19.602913 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-3c05dae6-e6c3-4841-97e5-683b3669c34f tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:19.610982 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-3c05dae6-e6c3-4841-97e5-683b3669c34f tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e" status: 200 len: 1358 microversion: 2.1 time: 0.420109 Sep 25 04:43:19.616412 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 395/852] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:43:19 2022] GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e => generated 1358 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:43:20.645298 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-e91f50ec-7bf3-41ea-abd6-9dfa920dcca2 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:20.646051 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-e91f50ec-7bf3-41ea-abd6-9dfa920dcca2 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: ffac6eac-431f-426a-9819-d3a16eebbd6e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:20.652144 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e91f50ec-7bf3-41ea-abd6-9dfa920dcca2 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:20.652628 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e91f50ec-7bf3-41ea-abd6-9dfa920dcca2 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:20.653108 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e91f50ec-7bf3-41ea-abd6-9dfa920dcca2 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:20.653796 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e91f50ec-7bf3-41ea-abd6-9dfa920dcca2 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:20.654250 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e91f50ec-7bf3-41ea-abd6-9dfa920dcca2 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:20.654676 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e91f50ec-7bf3-41ea-abd6-9dfa920dcca2 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:20.788773 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-e91f50ec-7bf3-41ea-abd6-9dfa920dcca2 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:20.792339 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=100 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:43:20.797763 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-e91f50ec-7bf3-41ea-abd6-9dfa920dcca2 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e" status: 200 len: 1358 microversion: 2.1 time: 0.157734 Sep 25 04:43:20.798334 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 458/853] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:43:20 2022] GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:43:21.824938 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-5e7f91ef-9a06-45d5-a312-7fc11a8b8399 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:21.826241 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-5e7f91ef-9a06-45d5-a312-7fc11a8b8399 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: ffac6eac-431f-426a-9819-d3a16eebbd6e] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:21.834327 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5e7f91ef-9a06-45d5-a312-7fc11a8b8399 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:21.835318 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5e7f91ef-9a06-45d5-a312-7fc11a8b8399 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:21.835759 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5e7f91ef-9a06-45d5-a312-7fc11a8b8399 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:21.836503 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5e7f91ef-9a06-45d5-a312-7fc11a8b8399 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:21.836992 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5e7f91ef-9a06-45d5-a312-7fc11a8b8399 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:21.837420 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5e7f91ef-9a06-45d5-a312-7fc11a8b8399 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:22.066357 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-5e7f91ef-9a06-45d5-a312-7fc11a8b8399 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:22.074474 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-5e7f91ef-9a06-45d5-a312-7fc11a8b8399 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e" status: 200 len: 1358 microversion: 2.1 time: 0.253902 Sep 25 04:43:22.079946 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 396/854] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:43:21 2022] GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e => generated 1358 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:43:23.100731 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-963bca97-eeac-4c61-b977-a5bc64ce911b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:23.101279 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-963bca97-eeac-4c61-b977-a5bc64ce911b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: ffac6eac-431f-426a-9819-d3a16eebbd6e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:23.103316 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell0:SELECT=4 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:43:23.109532 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-963bca97-eeac-4c61-b977-a5bc64ce911b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:23.110049 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-963bca97-eeac-4c61-b977-a5bc64ce911b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:23.110481 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-963bca97-eeac-4c61-b977-a5bc64ce911b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:23.111170 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-963bca97-eeac-4c61-b977-a5bc64ce911b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:23.111619 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-963bca97-eeac-4c61-b977-a5bc64ce911b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:23.112041 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-963bca97-eeac-4c61-b977-a5bc64ce911b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:23.242739 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-963bca97-eeac-4c61-b977-a5bc64ce911b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:23.250324 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-963bca97-eeac-4c61-b977-a5bc64ce911b tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e" status: 200 len: 1358 microversion: 2.1 time: 0.154924 Sep 25 04:43:23.250888 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 459/855] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:43:23 2022] GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:43:24.273978 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-12fc8c3e-7e9d-4610-b00f-8359aa0bc312 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:24.274609 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-12fc8c3e-7e9d-4610-b00f-8359aa0bc312 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: ffac6eac-431f-426a-9819-d3a16eebbd6e] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:24.277228 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell0:SELECT=2 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:43:24.282581 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-12fc8c3e-7e9d-4610-b00f-8359aa0bc312 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:24.283070 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-12fc8c3e-7e9d-4610-b00f-8359aa0bc312 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:24.283501 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-12fc8c3e-7e9d-4610-b00f-8359aa0bc312 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:24.284197 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-12fc8c3e-7e9d-4610-b00f-8359aa0bc312 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:24.285996 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-12fc8c3e-7e9d-4610-b00f-8359aa0bc312 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:24.286450 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-12fc8c3e-7e9d-4610-b00f-8359aa0bc312 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:24.414180 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell0:SELECT=8 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:43:24.428625 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-12fc8c3e-7e9d-4610-b00f-8359aa0bc312 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:24.436790 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-12fc8c3e-7e9d-4610-b00f-8359aa0bc312 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e" status: 200 len: 1358 microversion: 2.1 time: 0.166813 Sep 25 04:43:24.437364 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 397/856] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:43:24 2022] GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:43:25.460701 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-acf33a75-a58c-4b3e-816f-fe371db886e1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:25.461356 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-acf33a75-a58c-4b3e-816f-fe371db886e1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: ffac6eac-431f-426a-9819-d3a16eebbd6e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:25.468867 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-acf33a75-a58c-4b3e-816f-fe371db886e1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:25.469599 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-acf33a75-a58c-4b3e-816f-fe371db886e1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:25.470202 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-acf33a75-a58c-4b3e-816f-fe371db886e1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:25.471078 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-acf33a75-a58c-4b3e-816f-fe371db886e1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:25.471689 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-acf33a75-a58c-4b3e-816f-fe371db886e1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:25.472295 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-acf33a75-a58c-4b3e-816f-fe371db886e1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:25.674503 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-acf33a75-a58c-4b3e-816f-fe371db886e1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:25.683086 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-acf33a75-a58c-4b3e-816f-fe371db886e1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e" status: 200 len: 1358 microversion: 2.1 time: 0.227107 Sep 25 04:43:25.697223 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 460/857] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:43:25 2022] GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:43:26.707902 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-ce2de260-bc99-41e2-8c93-1406f034c184 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:26.708982 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-ce2de260-bc99-41e2-8c93-1406f034c184 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: ffac6eac-431f-426a-9819-d3a16eebbd6e] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:26.717281 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ce2de260-bc99-41e2-8c93-1406f034c184 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:26.717940 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ce2de260-bc99-41e2-8c93-1406f034c184 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:26.718392 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ce2de260-bc99-41e2-8c93-1406f034c184 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:26.719135 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ce2de260-bc99-41e2-8c93-1406f034c184 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:26.719599 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ce2de260-bc99-41e2-8c93-1406f034c184 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:26.720507 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ce2de260-bc99-41e2-8c93-1406f034c184 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:26.997824 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-ce2de260-bc99-41e2-8c93-1406f034c184 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:27.005745 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-ce2de260-bc99-41e2-8c93-1406f034c184 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e" status: 200 len: 1358 microversion: 2.1 time: 0.302547 Sep 25 04:43:27.006430 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 398/858] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:43:26 2022] GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e => generated 1358 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:43:28.031113 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-0a7fbbde-c368-420b-8496-bee3a0171150 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:28.031718 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-0a7fbbde-c368-420b-8496-bee3a0171150 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: ffac6eac-431f-426a-9819-d3a16eebbd6e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:28.037975 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0a7fbbde-c368-420b-8496-bee3a0171150 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:28.038452 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0a7fbbde-c368-420b-8496-bee3a0171150 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:28.038890 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0a7fbbde-c368-420b-8496-bee3a0171150 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:28.039569 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0a7fbbde-c368-420b-8496-bee3a0171150 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:28.040012 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0a7fbbde-c368-420b-8496-bee3a0171150 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:28.040432 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0a7fbbde-c368-420b-8496-bee3a0171150 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:28.169068 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-0a7fbbde-c368-420b-8496-bee3a0171150 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:28.176626 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-0a7fbbde-c368-420b-8496-bee3a0171150 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e" status: 200 len: 1358 microversion: 2.1 time: 0.149579 Sep 25 04:43:28.177202 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 461/859] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:43:28 2022] GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:43:29.200523 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-b5737e2e-5ace-46d2-aec2-59483224fe3d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:29.201164 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-b5737e2e-5ace-46d2-aec2-59483224fe3d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: ffac6eac-431f-426a-9819-d3a16eebbd6e] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:29.207509 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b5737e2e-5ace-46d2-aec2-59483224fe3d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:29.208192 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b5737e2e-5ace-46d2-aec2-59483224fe3d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:29.208822 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b5737e2e-5ace-46d2-aec2-59483224fe3d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:29.209698 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b5737e2e-5ace-46d2-aec2-59483224fe3d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:29.210156 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b5737e2e-5ace-46d2-aec2-59483224fe3d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:29.210577 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b5737e2e-5ace-46d2-aec2-59483224fe3d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:29.357155 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-b5737e2e-5ace-46d2-aec2-59483224fe3d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:29.366945 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-b5737e2e-5ace-46d2-aec2-59483224fe3d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e" status: 200 len: 1358 microversion: 2.1 time: 0.170548 Sep 25 04:43:29.368032 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 399/860] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:43:29 2022] GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:43:30.389530 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-681f382f-4193-4600-a5eb-ddb6cd5f2a43 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:30.390165 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-681f382f-4193-4600-a5eb-ddb6cd5f2a43 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: ffac6eac-431f-426a-9819-d3a16eebbd6e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:30.397279 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-681f382f-4193-4600-a5eb-ddb6cd5f2a43 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:30.397768 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-681f382f-4193-4600-a5eb-ddb6cd5f2a43 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:30.398198 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-681f382f-4193-4600-a5eb-ddb6cd5f2a43 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:30.399149 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-681f382f-4193-4600-a5eb-ddb6cd5f2a43 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:30.399650 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-681f382f-4193-4600-a5eb-ddb6cd5f2a43 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:30.400009 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-681f382f-4193-4600-a5eb-ddb6cd5f2a43 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:30.532592 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-681f382f-4193-4600-a5eb-ddb6cd5f2a43 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:30.540368 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-681f382f-4193-4600-a5eb-ddb6cd5f2a43 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e" status: 200 len: 1358 microversion: 2.1 time: 0.154639 Sep 25 04:43:30.540964 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 462/861] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:43:30 2022] GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:43:31.294754 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [req-813d4650-203c-465a-9375-c83f30c88538 req-b9ad7c60-f810-4b9d-b0aa-f71a1285121f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffac6eac-431f-426a-9819-d3a16eebbd6e", "name": "network-vif-plugged", "status": "completed", "tag": "fe1a7c5e-cb1e-42df-9efe-1f8099bbc117"}]} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:43:31.306067 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-813d4650-203c-465a-9375-c83f30c88538 req-b9ad7c60-f810-4b9d-b0aa-f71a1285121f service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:31.306555 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-813d4650-203c-465a-9375-c83f30c88538 req-b9ad7c60-f810-4b9d-b0aa-f71a1285121f service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:31.306991 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-813d4650-203c-465a-9375-c83f30c88538 req-b9ad7c60-f810-4b9d-b0aa-f71a1285121f service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:31.321252 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.compute.server_external_events [req-813d4650-203c-465a-9375-c83f30c88538 req-b9ad7c60-f810-4b9d-b0aa-f71a1285121f service nova] Creating event network-vif-plugged:fe1a7c5e-cb1e-42df-9efe-1f8099bbc117 for instance ffac6eac-431f-426a-9819-d3a16eebbd6e on hv-cinder-85535 Sep 25 04:43:31.326271 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [req-813d4650-203c-465a-9375-c83f30c88538 req-b9ad7c60-f810-4b9d-b0aa-f71a1285121f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035326 Sep 25 04:43:31.327033 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 400/862] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:43:31.563692 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-09c2612f-1f9a-48eb-bdef-9c67c04bdcfe tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:31.564352 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-09c2612f-1f9a-48eb-bdef-9c67c04bdcfe tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: ffac6eac-431f-426a-9819-d3a16eebbd6e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:31.572153 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-09c2612f-1f9a-48eb-bdef-9c67c04bdcfe tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:31.572660 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-09c2612f-1f9a-48eb-bdef-9c67c04bdcfe tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:31.573126 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-09c2612f-1f9a-48eb-bdef-9c67c04bdcfe tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:31.574256 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-09c2612f-1f9a-48eb-bdef-9c67c04bdcfe tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:31.574721 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-09c2612f-1f9a-48eb-bdef-9c67c04bdcfe tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:31.575150 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-09c2612f-1f9a-48eb-bdef-9c67c04bdcfe tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:31.753839 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-09c2612f-1f9a-48eb-bdef-9c67c04bdcfe tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:31.756914 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-09c2612f-1f9a-48eb-bdef-9c67c04bdcfe tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e" status: 200 len: 1358 microversion: 2.1 time: 0.197368 Sep 25 04:43:31.757477 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 463/863] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:43:31 2022] GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:43:32.780351 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-5339afa2-3d4a-42a3-baf9-2b1ad72d3c17 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:32.781144 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-5339afa2-3d4a-42a3-baf9-2b1ad72d3c17 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: ffac6eac-431f-426a-9819-d3a16eebbd6e] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:32.788113 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5339afa2-3d4a-42a3-baf9-2b1ad72d3c17 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:32.788601 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5339afa2-3d4a-42a3-baf9-2b1ad72d3c17 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:32.789062 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5339afa2-3d4a-42a3-baf9-2b1ad72d3c17 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:32.789761 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5339afa2-3d4a-42a3-baf9-2b1ad72d3c17 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:32.790219 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5339afa2-3d4a-42a3-baf9-2b1ad72d3c17 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:32.790643 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5339afa2-3d4a-42a3-baf9-2b1ad72d3c17 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:32.950926 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-5339afa2-3d4a-42a3-baf9-2b1ad72d3c17 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:32.958787 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-5339afa2-3d4a-42a3-baf9-2b1ad72d3c17 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e" status: 200 len: 1358 microversion: 2.1 time: 0.183142 Sep 25 04:43:32.959496 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 401/864] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:43:32 2022] GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:43:33.982899 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-9556344b-6091-49a1-a521-09c88e392029 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:33.983615 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-9556344b-6091-49a1-a521-09c88e392029 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: ffac6eac-431f-426a-9819-d3a16eebbd6e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:33.990309 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9556344b-6091-49a1-a521-09c88e392029 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:33.990803 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9556344b-6091-49a1-a521-09c88e392029 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:33.991250 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9556344b-6091-49a1-a521-09c88e392029 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:33.991949 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9556344b-6091-49a1-a521-09c88e392029 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:33.992409 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9556344b-6091-49a1-a521-09c88e392029 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:33.992867 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9556344b-6091-49a1-a521-09c88e392029 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:34.136575 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-9556344b-6091-49a1-a521-09c88e392029 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:34.144621 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-9556344b-6091-49a1-a521-09c88e392029 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e" status: 200 len: 1544 microversion: 2.1 time: 0.165676 Sep 25 04:43:34.145963 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 464/865] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:43:33 2022] GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e => generated 1544 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:43:34.170017 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-b552ced0-5071-40ac-a364-acb902b0775a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:34.170564 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-b552ced0-5071-40ac-a364-acb902b0775a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: ffac6eac-431f-426a-9819-d3a16eebbd6e] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:34.183307 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b552ced0-5071-40ac-a364-acb902b0775a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:34.183882 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b552ced0-5071-40ac-a364-acb902b0775a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:34.184385 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b552ced0-5071-40ac-a364-acb902b0775a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:34.185324 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b552ced0-5071-40ac-a364-acb902b0775a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:34.185970 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b552ced0-5071-40ac-a364-acb902b0775a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:34.186415 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b552ced0-5071-40ac-a364-acb902b0775a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:34.267134 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-b552ced0-5071-40ac-a364-acb902b0775a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101611 Sep 25 04:43:34.267884 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 402/866] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Sep 25 04:43:34 2022] GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:43:35.239275 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-bc806c43-369f-4c9a-bca0-6a9097b8ebc8 req-d3f11e27-c2d5-4e29-9d54-8957a58ac218 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffac6eac-431f-426a-9819-d3a16eebbd6e", "tag": "fe1a7c5e-cb1e-42df-9efe-1f8099bbc117"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:43:35.250365 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-bc806c43-369f-4c9a-bca0-6a9097b8ebc8 req-d3f11e27-c2d5-4e29-9d54-8957a58ac218 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:35.251084 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-bc806c43-369f-4c9a-bca0-6a9097b8ebc8 req-d3f11e27-c2d5-4e29-9d54-8957a58ac218 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:35.251634 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-bc806c43-369f-4c9a-bca0-6a9097b8ebc8 req-d3f11e27-c2d5-4e29-9d54-8957a58ac218 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:35.263495 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-bc806c43-369f-4c9a-bca0-6a9097b8ebc8 req-d3f11e27-c2d5-4e29-9d54-8957a58ac218 service nova] Creating event network-changed:fe1a7c5e-cb1e-42df-9efe-1f8099bbc117 for instance ffac6eac-431f-426a-9819-d3a16eebbd6e on hv-cinder-85535 Sep 25 04:43:35.268901 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-bc806c43-369f-4c9a-bca0-6a9097b8ebc8 req-d3f11e27-c2d5-4e29-9d54-8957a58ac218 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036002 Sep 25 04:43:35.269593 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 465/867] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:43:54.434388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:43:54.435169 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=42 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:43:54.439142 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-0c92c789-2494-402f-9843-329cba5380a4 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1604813392", "imageRef": "e5cfdbb2-d0ce-4736-b311-1a3c155844e9", "flavorRef": "452", "networks": [{"uuid": "f8625bfd-62f4-4562-b0e4-5c8d81fc13fb"}]}} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:43:54.495917 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.network.neutron [None req-0c92c789-2494-402f-9843-329cba5380a4 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] validate_networks() for [('f8625bfd-62f4-4562-b0e4-5c8d81fc13fb', None, None, None, None, None)] {{(pid=127141) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 04:43:55.074738 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-0c92c789-2494-402f-9843-329cba5380a4 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Flavor limits 0:0:0 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 04:43:55.075164 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-0c92c789-2494-402f-9843-329cba5380a4 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Image limits 0:0:0 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 04:43:55.075711 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-0c92c789-2494-402f-9843-329cba5380a4 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Flavor pref 0:0:0 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 04:43:55.076131 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-0c92c789-2494-402f-9843-329cba5380a4 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Image pref 0:0:0 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 04:43:55.076546 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-0c92c789-2494-402f-9843-329cba5380a4 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 04:43:55.085476 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0c92c789-2494-402f-9843-329cba5380a4 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:55.085959 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0c92c789-2494-402f-9843-329cba5380a4 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:55.086393 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0c92c789-2494-402f-9843-329cba5380a4 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:55.087116 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0c92c789-2494-402f-9843-329cba5380a4 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:55.087583 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0c92c789-2494-402f-9843-329cba5380a4 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:55.088002 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0c92c789-2494-402f-9843-329cba5380a4 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:55.104815 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.quota [None req-0c92c789-2494-402f-9843-329cba5380a4 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Getting quotas for project 8fb362553bd743bfbbe783296f2597e0. Resources: {'instances', 'ram', 'cores'} {{(pid=127141) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 04:43:55.108806 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.quota [None req-0c92c789-2494-402f-9843-329cba5380a4 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Getting quotas for user cad7c7ccaeef409ebb5af348300068f5 and project 8fb362553bd743bfbbe783296f2597e0. Resources: {'instances', 'ram', 'cores'} {{(pid=127141) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 04:43:55.120221 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-0c92c789-2494-402f-9843-329cba5380a4 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Going to run 1 instances... {{(pid=127141) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 04:43:55.122516 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-0c92c789-2494-402f-9843-329cba5380a4 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: 6b648f87-b6d8-47f4-9633-256c3bed404d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5cfdbb2-d0ce-4736-b311-1a3c155844e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127141) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 04:43:55.167831 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-0c92c789-2494-402f-9843-329cba5380a4 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.735015 Sep 25 04:43:55.168409 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 403/868] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 25 04:43:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 04:43:55.178451 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:43:55.179181 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=38 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:43:55.185279 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-0dd20c61-9cca-40a6-94aa-16185ede8e28 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:55.186371 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-0dd20c61-9cca-40a6-94aa-16185ede8e28 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: 6b648f87-b6d8-47f4-9633-256c3bed404d] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:55.241574 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-0dd20c61-9cca-40a6-94aa-16185ede8e28 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad7c7ccaeef409ebb5af348300068f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb362553bd743bfbbe783296f2597e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:55.248518 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-0dd20c61-9cca-40a6-94aa-16185ede8e28 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "GET /compute/v2.1/servers/6b648f87-b6d8-47f4-9633-256c3bed404d" status: 200 len: 1214 microversion: 2.1 time: 0.072791 Sep 25 04:43:55.249124 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 466/869] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:43:55 2022] GET /compute/v2.1/servers/6b648f87-b6d8-47f4-9633-256c3bed404d => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:43:56.272672 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-8d78b323-7f1a-43e6-a8ac-9c09874c097f tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:56.273299 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-8d78b323-7f1a-43e6-a8ac-9c09874c097f tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: 6b648f87-b6d8-47f4-9633-256c3bed404d] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:56.279552 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8d78b323-7f1a-43e6-a8ac-9c09874c097f tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:56.280042 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8d78b323-7f1a-43e6-a8ac-9c09874c097f tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:56.280698 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8d78b323-7f1a-43e6-a8ac-9c09874c097f tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:56.281411 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8d78b323-7f1a-43e6-a8ac-9c09874c097f tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:56.281875 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8d78b323-7f1a-43e6-a8ac-9c09874c097f tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:56.282302 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8d78b323-7f1a-43e6-a8ac-9c09874c097f tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:56.353407 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-8d78b323-7f1a-43e6-a8ac-9c09874c097f tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad7c7ccaeef409ebb5af348300068f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb362553bd743bfbbe783296f2597e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:56.361606 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-8d78b323-7f1a-43e6-a8ac-9c09874c097f tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "GET /compute/v2.1/servers/6b648f87-b6d8-47f4-9633-256c3bed404d" status: 200 len: 1266 microversion: 2.1 time: 0.094287 Sep 25 04:43:56.362161 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 404/870] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:43:56 2022] GET /compute/v2.1/servers/6b648f87-b6d8-47f4-9633-256c3bed404d => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:43:57.387559 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-bbad060b-d59f-4179-9ad8-c8bbea07479f tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:57.388182 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-bbad060b-d59f-4179-9ad8-c8bbea07479f tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: 6b648f87-b6d8-47f4-9633-256c3bed404d] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:57.395107 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bbad060b-d59f-4179-9ad8-c8bbea07479f tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:57.395605 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bbad060b-d59f-4179-9ad8-c8bbea07479f tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:57.396044 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bbad060b-d59f-4179-9ad8-c8bbea07479f tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:57.396795 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bbad060b-d59f-4179-9ad8-c8bbea07479f tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:57.397256 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bbad060b-d59f-4179-9ad8-c8bbea07479f tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:57.397685 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bbad060b-d59f-4179-9ad8-c8bbea07479f tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:57.618694 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-bbad060b-d59f-4179-9ad8-c8bbea07479f tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad7c7ccaeef409ebb5af348300068f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb362553bd743bfbbe783296f2597e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:57.626626 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-bbad060b-d59f-4179-9ad8-c8bbea07479f tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "GET /compute/v2.1/servers/6b648f87-b6d8-47f4-9633-256c3bed404d" status: 200 len: 1314 microversion: 2.1 time: 0.244296 Sep 25 04:43:57.627281 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 467/871] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:43:57 2022] GET /compute/v2.1/servers/6b648f87-b6d8-47f4-9633-256c3bed404d => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:43:58.218795 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [req-06af8878-5022-4c2e-8ec3-881f89f83c27 req-96e1a88e-6b24-4985-b382-948ab4d5799d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b648f87-b6d8-47f4-9633-256c3bed404d", "tag": "4b72a5cd-1073-415f-bdc2-163c93bd3c2c"}]} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:43:58.229981 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-06af8878-5022-4c2e-8ec3-881f89f83c27 req-96e1a88e-6b24-4985-b382-948ab4d5799d service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:58.230692 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-06af8878-5022-4c2e-8ec3-881f89f83c27 req-96e1a88e-6b24-4985-b382-948ab4d5799d service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:58.231125 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-06af8878-5022-4c2e-8ec3-881f89f83c27 req-96e1a88e-6b24-4985-b382-948ab4d5799d service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:58.245137 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.compute.server_external_events [req-06af8878-5022-4c2e-8ec3-881f89f83c27 req-96e1a88e-6b24-4985-b382-948ab4d5799d service nova] Creating event network-changed:4b72a5cd-1073-415f-bdc2-163c93bd3c2c for instance 6b648f87-b6d8-47f4-9633-256c3bed404d on hv-cinder-85535 Sep 25 04:43:58.250082 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [req-06af8878-5022-4c2e-8ec3-881f89f83c27 req-96e1a88e-6b24-4985-b382-948ab4d5799d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034936 Sep 25 04:43:58.251231 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 405/872] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 04:43:58.650915 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-cdfe5870-c17f-4b08-99b3-6a8c383e05dd tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:58.651529 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-cdfe5870-c17f-4b08-99b3-6a8c383e05dd tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: 6b648f87-b6d8-47f4-9633-256c3bed404d] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:58.657983 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cdfe5870-c17f-4b08-99b3-6a8c383e05dd tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:58.658467 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cdfe5870-c17f-4b08-99b3-6a8c383e05dd tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:58.658902 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cdfe5870-c17f-4b08-99b3-6a8c383e05dd tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:58.659588 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cdfe5870-c17f-4b08-99b3-6a8c383e05dd tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:58.660797 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cdfe5870-c17f-4b08-99b3-6a8c383e05dd tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:58.661243 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cdfe5870-c17f-4b08-99b3-6a8c383e05dd tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:58.794670 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-cdfe5870-c17f-4b08-99b3-6a8c383e05dd tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad7c7ccaeef409ebb5af348300068f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb362553bd743bfbbe783296f2597e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:58.802641 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-cdfe5870-c17f-4b08-99b3-6a8c383e05dd tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "GET /compute/v2.1/servers/6b648f87-b6d8-47f4-9633-256c3bed404d" status: 200 len: 1314 microversion: 2.1 time: 0.155593 Sep 25 04:43:58.803214 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 468/873] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:43:58 2022] GET /compute/v2.1/servers/6b648f87-b6d8-47f4-9633-256c3bed404d => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:43:59.826710 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-2f04f75a-b6b2-4d92-acf2-978303c062af tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:43:59.827321 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-2f04f75a-b6b2-4d92-acf2-978303c062af tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: 6b648f87-b6d8-47f4-9633-256c3bed404d] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:43:59.833620 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2f04f75a-b6b2-4d92-acf2-978303c062af tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:59.834109 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2f04f75a-b6b2-4d92-acf2-978303c062af tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:59.834558 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2f04f75a-b6b2-4d92-acf2-978303c062af tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:59.835247 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2f04f75a-b6b2-4d92-acf2-978303c062af tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:43:59.835706 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2f04f75a-b6b2-4d92-acf2-978303c062af tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:43:59.836134 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2f04f75a-b6b2-4d92-acf2-978303c062af tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:43:59.961763 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-2f04f75a-b6b2-4d92-acf2-978303c062af tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad7c7ccaeef409ebb5af348300068f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb362553bd743bfbbe783296f2597e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:43:59.969642 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-2f04f75a-b6b2-4d92-acf2-978303c062af tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "GET /compute/v2.1/servers/6b648f87-b6d8-47f4-9633-256c3bed404d" status: 200 len: 1314 microversion: 2.1 time: 0.147712 Sep 25 04:43:59.970206 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 406/874] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:43:59 2022] GET /compute/v2.1/servers/6b648f87-b6d8-47f4-9633-256c3bed404d => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:00.993916 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-81f2ef15-1b9f-4583-a11e-43227482360e tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:00.994521 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-81f2ef15-1b9f-4583-a11e-43227482360e tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: 6b648f87-b6d8-47f4-9633-256c3bed404d] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:01.000981 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-81f2ef15-1b9f-4583-a11e-43227482360e tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:01.001461 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-81f2ef15-1b9f-4583-a11e-43227482360e tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:01.001890 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-81f2ef15-1b9f-4583-a11e-43227482360e tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:01.002569 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-81f2ef15-1b9f-4583-a11e-43227482360e tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:01.003020 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-81f2ef15-1b9f-4583-a11e-43227482360e tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:01.003440 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-81f2ef15-1b9f-4583-a11e-43227482360e tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:01.134730 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-81f2ef15-1b9f-4583-a11e-43227482360e tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad7c7ccaeef409ebb5af348300068f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb362553bd743bfbbe783296f2597e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:01.142305 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-81f2ef15-1b9f-4583-a11e-43227482360e tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "GET /compute/v2.1/servers/6b648f87-b6d8-47f4-9633-256c3bed404d" status: 200 len: 1314 microversion: 2.1 time: 0.152246 Sep 25 04:44:01.142862 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 469/875] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:00 2022] GET /compute/v2.1/servers/6b648f87-b6d8-47f4-9633-256c3bed404d => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:02.164354 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-76804007-ac55-4e4e-b765-a8c7299452b8 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:02.165002 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-76804007-ac55-4e4e-b765-a8c7299452b8 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: 6b648f87-b6d8-47f4-9633-256c3bed404d] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:02.171585 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-76804007-ac55-4e4e-b765-a8c7299452b8 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:02.172074 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-76804007-ac55-4e4e-b765-a8c7299452b8 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:02.172512 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-76804007-ac55-4e4e-b765-a8c7299452b8 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:02.173238 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-76804007-ac55-4e4e-b765-a8c7299452b8 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:02.173695 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-76804007-ac55-4e4e-b765-a8c7299452b8 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:02.174123 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-76804007-ac55-4e4e-b765-a8c7299452b8 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:02.378401 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-76804007-ac55-4e4e-b765-a8c7299452b8 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad7c7ccaeef409ebb5af348300068f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb362553bd743bfbbe783296f2597e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:02.386728 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-76804007-ac55-4e4e-b765-a8c7299452b8 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "GET /compute/v2.1/servers/6b648f87-b6d8-47f4-9633-256c3bed404d" status: 200 len: 1314 microversion: 2.1 time: 0.226272 Sep 25 04:44:02.387307 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 407/876] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:02 2022] GET /compute/v2.1/servers/6b648f87-b6d8-47f4-9633-256c3bed404d => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:03.409101 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-91f65e4a-fe33-4b6f-a699-a0436878762a tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:03.409707 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-91f65e4a-fe33-4b6f-a699-a0436878762a tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: 6b648f87-b6d8-47f4-9633-256c3bed404d] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:03.416579 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-91f65e4a-fe33-4b6f-a699-a0436878762a tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:03.417197 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-91f65e4a-fe33-4b6f-a699-a0436878762a tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:03.417660 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-91f65e4a-fe33-4b6f-a699-a0436878762a tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:03.418352 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-91f65e4a-fe33-4b6f-a699-a0436878762a tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:03.418950 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-91f65e4a-fe33-4b6f-a699-a0436878762a tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:03.419404 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-91f65e4a-fe33-4b6f-a699-a0436878762a tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:03.549168 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-91f65e4a-fe33-4b6f-a699-a0436878762a tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad7c7ccaeef409ebb5af348300068f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb362553bd743bfbbe783296f2597e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:03.556666 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-91f65e4a-fe33-4b6f-a699-a0436878762a tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "GET /compute/v2.1/servers/6b648f87-b6d8-47f4-9633-256c3bed404d" status: 200 len: 1314 microversion: 2.1 time: 0.151382 Sep 25 04:44:03.557242 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 470/877] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:03 2022] GET /compute/v2.1/servers/6b648f87-b6d8-47f4-9633-256c3bed404d => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:04.579777 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-5bcfc6d7-8521-42f3-8819-8281dd055cf1 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:04.580397 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-5bcfc6d7-8521-42f3-8819-8281dd055cf1 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: 6b648f87-b6d8-47f4-9633-256c3bed404d] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:04.587377 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5bcfc6d7-8521-42f3-8819-8281dd055cf1 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:04.587873 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5bcfc6d7-8521-42f3-8819-8281dd055cf1 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:04.588578 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5bcfc6d7-8521-42f3-8819-8281dd055cf1 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:04.589297 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5bcfc6d7-8521-42f3-8819-8281dd055cf1 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:04.589789 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5bcfc6d7-8521-42f3-8819-8281dd055cf1 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:04.590224 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5bcfc6d7-8521-42f3-8819-8281dd055cf1 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:04.719804 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-5bcfc6d7-8521-42f3-8819-8281dd055cf1 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad7c7ccaeef409ebb5af348300068f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb362553bd743bfbbe783296f2597e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:04.728448 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-5bcfc6d7-8521-42f3-8819-8281dd055cf1 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "GET /compute/v2.1/servers/6b648f87-b6d8-47f4-9633-256c3bed404d" status: 200 len: 1314 microversion: 2.1 time: 0.152572 Sep 25 04:44:04.729054 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 408/878] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:04 2022] GET /compute/v2.1/servers/6b648f87-b6d8-47f4-9633-256c3bed404d => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:05.402336 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-fcab9d17-ae66-4b36-987b-c8f69bba76d3 req-526cd765-b3de-4768-8bbf-b3c905f74b4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b648f87-b6d8-47f4-9633-256c3bed404d", "name": "network-vif-plugged", "status": "completed", "tag": "4b72a5cd-1073-415f-bdc2-163c93bd3c2c"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:44:05.407935 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell0:SELECT=2 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:44:05.414789 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-fcab9d17-ae66-4b36-987b-c8f69bba76d3 req-526cd765-b3de-4768-8bbf-b3c905f74b4e service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:05.415272 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-fcab9d17-ae66-4b36-987b-c8f69bba76d3 req-526cd765-b3de-4768-8bbf-b3c905f74b4e service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:05.415704 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-fcab9d17-ae66-4b36-987b-c8f69bba76d3 req-526cd765-b3de-4768-8bbf-b3c905f74b4e service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:05.427449 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-fcab9d17-ae66-4b36-987b-c8f69bba76d3 req-526cd765-b3de-4768-8bbf-b3c905f74b4e service nova] Creating event network-vif-plugged:4b72a5cd-1073-415f-bdc2-163c93bd3c2c for instance 6b648f87-b6d8-47f4-9633-256c3bed404d on hv-cinder-85535 Sep 25 04:44:05.432400 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-fcab9d17-ae66-4b36-987b-c8f69bba76d3 req-526cd765-b3de-4768-8bbf-b3c905f74b4e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033826 Sep 25 04:44:05.433193 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 471/879] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:44:05.751504 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-b4bd1383-50d1-450b-81a3-d9fcb3fc595a tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:05.752180 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-b4bd1383-50d1-450b-81a3-d9fcb3fc595a tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: 6b648f87-b6d8-47f4-9633-256c3bed404d] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:05.754130 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell0:SELECT=2 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:44:05.755168 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell0:SELECT=6 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:44:05.761585 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b4bd1383-50d1-450b-81a3-d9fcb3fc595a tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:05.762078 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b4bd1383-50d1-450b-81a3-d9fcb3fc595a tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:05.762524 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b4bd1383-50d1-450b-81a3-d9fcb3fc595a tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:05.763219 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b4bd1383-50d1-450b-81a3-d9fcb3fc595a tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:05.763682 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b4bd1383-50d1-450b-81a3-d9fcb3fc595a tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:05.764115 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b4bd1383-50d1-450b-81a3-d9fcb3fc595a tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:05.893596 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-b4bd1383-50d1-450b-81a3-d9fcb3fc595a tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad7c7ccaeef409ebb5af348300068f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb362553bd743bfbbe783296f2597e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:05.901215 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-b4bd1383-50d1-450b-81a3-d9fcb3fc595a tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "GET /compute/v2.1/servers/6b648f87-b6d8-47f4-9633-256c3bed404d" status: 200 len: 1314 microversion: 2.1 time: 0.153795 Sep 25 04:44:05.901983 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 409/880] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:05 2022] GET /compute/v2.1/servers/6b648f87-b6d8-47f4-9633-256c3bed404d => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:06.925908 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-3c976a38-e9b5-4412-8258-a3b6a9f64ea5 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:06.927239 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-3c976a38-e9b5-4412-8258-a3b6a9f64ea5 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: 6b648f87-b6d8-47f4-9633-256c3bed404d] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:06.933453 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3c976a38-e9b5-4412-8258-a3b6a9f64ea5 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:06.933937 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3c976a38-e9b5-4412-8258-a3b6a9f64ea5 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:06.934370 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3c976a38-e9b5-4412-8258-a3b6a9f64ea5 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:06.935070 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3c976a38-e9b5-4412-8258-a3b6a9f64ea5 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:06.935509 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3c976a38-e9b5-4412-8258-a3b6a9f64ea5 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:06.935933 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3c976a38-e9b5-4412-8258-a3b6a9f64ea5 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:07.065433 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-3c976a38-e9b5-4412-8258-a3b6a9f64ea5 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad7c7ccaeef409ebb5af348300068f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb362553bd743bfbbe783296f2597e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:07.073818 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-3c976a38-e9b5-4412-8258-a3b6a9f64ea5 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "GET /compute/v2.1/servers/6b648f87-b6d8-47f4-9633-256c3bed404d" status: 200 len: 1314 microversion: 2.1 time: 0.152505 Sep 25 04:44:07.074432 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 472/881] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:06 2022] GET /compute/v2.1/servers/6b648f87-b6d8-47f4-9633-256c3bed404d => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:08.096927 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-979936d1-fbda-49a5-800f-79f22a35bb1e tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:08.097543 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-979936d1-fbda-49a5-800f-79f22a35bb1e tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: 6b648f87-b6d8-47f4-9633-256c3bed404d] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:08.104091 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-979936d1-fbda-49a5-800f-79f22a35bb1e tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:08.104578 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-979936d1-fbda-49a5-800f-79f22a35bb1e tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:08.105053 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-979936d1-fbda-49a5-800f-79f22a35bb1e tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:08.105746 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-979936d1-fbda-49a5-800f-79f22a35bb1e tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:08.106209 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-979936d1-fbda-49a5-800f-79f22a35bb1e tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:08.106639 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-979936d1-fbda-49a5-800f-79f22a35bb1e tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:08.237050 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-979936d1-fbda-49a5-800f-79f22a35bb1e tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad7c7ccaeef409ebb5af348300068f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb362553bd743bfbbe783296f2597e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:08.245578 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-979936d1-fbda-49a5-800f-79f22a35bb1e tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "GET /compute/v2.1/servers/6b648f87-b6d8-47f4-9633-256c3bed404d" status: 200 len: 1498 microversion: 2.1 time: 0.152523 Sep 25 04:44:08.246159 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 410/882] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:08 2022] GET /compute/v2.1/servers/6b648f87-b6d8-47f4-9633-256c3bed404d => generated 1498 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:08.734595 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-12598c61-e60f-4dcb-ba68-acb3369c97c8 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:08.735088 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-12598c61-e60f-4dcb-ba68-acb3369c97c8 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: 6b648f87-b6d8-47f4-9633-256c3bed404d] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:08.742355 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-12598c61-e60f-4dcb-ba68-acb3369c97c8 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:08.742839 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-12598c61-e60f-4dcb-ba68-acb3369c97c8 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:08.743274 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-12598c61-e60f-4dcb-ba68-acb3369c97c8 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:08.743959 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-12598c61-e60f-4dcb-ba68-acb3369c97c8 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:08.744413 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-12598c61-e60f-4dcb-ba68-acb3369c97c8 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:08.744876 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-12598c61-e60f-4dcb-ba68-acb3369c97c8 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:08.919758 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-12598c61-e60f-4dcb-ba68-acb3369c97c8 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: 6b648f87-b6d8-47f4-9633-256c3bed404d] Going to try to terminate instance {{(pid=127142) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 04:44:08.995228 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-12598c61-e60f-4dcb-ba68-acb3369c97c8 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6b648f87-b6d8-47f4-9633-256c3bed404d" status: 204 len: 0 microversion: 2.1 time: 0.264015 Sep 25 04:44:08.995832 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 473/883] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 25 04:44:08 2022] DELETE /compute/v2.1/servers/6b648f87-b6d8-47f4-9633-256c3bed404d => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 04:44:09.004940 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-c979465b-1736-430b-ac02-1a44f68cd36b tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:09.005617 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-c979465b-1736-430b-ac02-1a44f68cd36b tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: 6b648f87-b6d8-47f4-9633-256c3bed404d] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:09.011829 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c979465b-1736-430b-ac02-1a44f68cd36b tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:09.012320 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c979465b-1736-430b-ac02-1a44f68cd36b tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:09.012796 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c979465b-1736-430b-ac02-1a44f68cd36b tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:09.013536 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c979465b-1736-430b-ac02-1a44f68cd36b tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:09.013997 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c979465b-1736-430b-ac02-1a44f68cd36b tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:09.014421 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c979465b-1736-430b-ac02-1a44f68cd36b tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:09.143494 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-c979465b-1736-430b-ac02-1a44f68cd36b tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad7c7ccaeef409ebb5af348300068f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb362553bd743bfbbe783296f2597e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:09.151973 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-c979465b-1736-430b-ac02-1a44f68cd36b tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "GET /compute/v2.1/servers/6b648f87-b6d8-47f4-9633-256c3bed404d" status: 200 len: 1504 microversion: 2.1 time: 0.151624 Sep 25 04:44:09.152536 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 411/884] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:08 2022] GET /compute/v2.1/servers/6b648f87-b6d8-47f4-9633-256c3bed404d => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:10.175865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-bbaff3b6-afd7-442c-b3a3-9ec67c00e2b0 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:10.177350 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-bbaff3b6-afd7-442c-b3a3-9ec67c00e2b0 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: 6b648f87-b6d8-47f4-9633-256c3bed404d] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:10.183785 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bbaff3b6-afd7-442c-b3a3-9ec67c00e2b0 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:10.184275 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bbaff3b6-afd7-442c-b3a3-9ec67c00e2b0 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:10.184737 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bbaff3b6-afd7-442c-b3a3-9ec67c00e2b0 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:10.185422 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bbaff3b6-afd7-442c-b3a3-9ec67c00e2b0 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:10.185874 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bbaff3b6-afd7-442c-b3a3-9ec67c00e2b0 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:10.186295 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bbaff3b6-afd7-442c-b3a3-9ec67c00e2b0 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:10.314821 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-bbaff3b6-afd7-442c-b3a3-9ec67c00e2b0 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad7c7ccaeef409ebb5af348300068f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb362553bd743bfbbe783296f2597e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:10.322526 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-bbaff3b6-afd7-442c-b3a3-9ec67c00e2b0 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "GET /compute/v2.1/servers/6b648f87-b6d8-47f4-9633-256c3bed404d" status: 200 len: 1504 microversion: 2.1 time: 0.150877 Sep 25 04:44:10.323094 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 474/885] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:10 2022] GET /compute/v2.1/servers/6b648f87-b6d8-47f4-9633-256c3bed404d => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:11.346589 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-3ac19ba6-9623-4e5e-80b3-0a1f316b71e5 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:11.347178 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-3ac19ba6-9623-4e5e-80b3-0a1f316b71e5 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: 6b648f87-b6d8-47f4-9633-256c3bed404d] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:11.353783 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3ac19ba6-9623-4e5e-80b3-0a1f316b71e5 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:11.354205 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3ac19ba6-9623-4e5e-80b3-0a1f316b71e5 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:11.354640 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3ac19ba6-9623-4e5e-80b3-0a1f316b71e5 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:11.355318 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3ac19ba6-9623-4e5e-80b3-0a1f316b71e5 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:11.355767 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3ac19ba6-9623-4e5e-80b3-0a1f316b71e5 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:11.356193 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3ac19ba6-9623-4e5e-80b3-0a1f316b71e5 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:11.637930 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-3ac19ba6-9623-4e5e-80b3-0a1f316b71e5 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad7c7ccaeef409ebb5af348300068f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb362553bd743bfbbe783296f2597e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:11.645785 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-3ac19ba6-9623-4e5e-80b3-0a1f316b71e5 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "GET /compute/v2.1/servers/6b648f87-b6d8-47f4-9633-256c3bed404d" status: 200 len: 1504 microversion: 2.1 time: 0.303013 Sep 25 04:44:11.646336 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 412/886] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:11 2022] GET /compute/v2.1/servers/6b648f87-b6d8-47f4-9633-256c3bed404d => generated 1504 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:44:12.669262 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-aab8f98c-1bd5-46e1-b242-7d8f9b29f6ec tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:12.669829 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-aab8f98c-1bd5-46e1-b242-7d8f9b29f6ec tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: 6b648f87-b6d8-47f4-9633-256c3bed404d] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:12.677249 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-aab8f98c-1bd5-46e1-b242-7d8f9b29f6ec tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:12.677736 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-aab8f98c-1bd5-46e1-b242-7d8f9b29f6ec tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:12.678179 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-aab8f98c-1bd5-46e1-b242-7d8f9b29f6ec tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:12.678876 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-aab8f98c-1bd5-46e1-b242-7d8f9b29f6ec tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:12.679337 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-aab8f98c-1bd5-46e1-b242-7d8f9b29f6ec tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:12.679767 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-aab8f98c-1bd5-46e1-b242-7d8f9b29f6ec tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:12.808518 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-aab8f98c-1bd5-46e1-b242-7d8f9b29f6ec tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad7c7ccaeef409ebb5af348300068f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb362553bd743bfbbe783296f2597e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:12.817363 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-aab8f98c-1bd5-46e1-b242-7d8f9b29f6ec tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "GET /compute/v2.1/servers/6b648f87-b6d8-47f4-9633-256c3bed404d" status: 200 len: 1504 microversion: 2.1 time: 0.151914 Sep 25 04:44:12.817936 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 475/887] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:12 2022] GET /compute/v2.1/servers/6b648f87-b6d8-47f4-9633-256c3bed404d => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:44:13.841570 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-e483f27a-eb6d-4380-b3b3-6d6578468120 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:13.842132 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-e483f27a-eb6d-4380-b3b3-6d6578468120 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: 6b648f87-b6d8-47f4-9633-256c3bed404d] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:13.848753 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e483f27a-eb6d-4380-b3b3-6d6578468120 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:13.849235 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e483f27a-eb6d-4380-b3b3-6d6578468120 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:13.849674 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e483f27a-eb6d-4380-b3b3-6d6578468120 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:13.850355 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e483f27a-eb6d-4380-b3b3-6d6578468120 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:13.850805 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e483f27a-eb6d-4380-b3b3-6d6578468120 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:13.851226 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e483f27a-eb6d-4380-b3b3-6d6578468120 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:13.980983 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-e483f27a-eb6d-4380-b3b3-6d6578468120 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad7c7ccaeef409ebb5af348300068f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb362553bd743bfbbe783296f2597e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:13.988563 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-e483f27a-eb6d-4380-b3b3-6d6578468120 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "GET /compute/v2.1/servers/6b648f87-b6d8-47f4-9633-256c3bed404d" status: 200 len: 1504 microversion: 2.1 time: 0.151176 Sep 25 04:44:13.990022 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 413/888] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:13 2022] GET /compute/v2.1/servers/6b648f87-b6d8-47f4-9633-256c3bed404d => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:14.813418 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-303882ce-e414-4492-a6a0-e0eb74e76833 req-21d700d3-6365-4a0f-a63e-c61a77f9593e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b648f87-b6d8-47f4-9633-256c3bed404d", "name": "network-vif-deleted", "tag": "4b72a5cd-1073-415f-bdc2-163c93bd3c2c"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:44:14.824300 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-303882ce-e414-4492-a6a0-e0eb74e76833 req-21d700d3-6365-4a0f-a63e-c61a77f9593e service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:14.824830 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-303882ce-e414-4492-a6a0-e0eb74e76833 req-21d700d3-6365-4a0f-a63e-c61a77f9593e service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:14.825268 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-303882ce-e414-4492-a6a0-e0eb74e76833 req-21d700d3-6365-4a0f-a63e-c61a77f9593e service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:14.837032 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-303882ce-e414-4492-a6a0-e0eb74e76833 req-21d700d3-6365-4a0f-a63e-c61a77f9593e service nova] Creating event network-vif-deleted:4b72a5cd-1073-415f-bdc2-163c93bd3c2c for instance 6b648f87-b6d8-47f4-9633-256c3bed404d on hv-cinder-85535 Sep 25 04:44:14.842177 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-303882ce-e414-4492-a6a0-e0eb74e76833 req-21d700d3-6365-4a0f-a63e-c61a77f9593e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032353 Sep 25 04:44:14.842764 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 476/889] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:44:15.013470 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-1f984cfc-1353-4815-a8d5-192ba8c99b63 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:15.014652 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-1f984cfc-1353-4815-a8d5-192ba8c99b63 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: 6b648f87-b6d8-47f4-9633-256c3bed404d] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:15.021996 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1f984cfc-1353-4815-a8d5-192ba8c99b63 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:15.022729 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1f984cfc-1353-4815-a8d5-192ba8c99b63 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:15.023174 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1f984cfc-1353-4815-a8d5-192ba8c99b63 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:15.023916 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1f984cfc-1353-4815-a8d5-192ba8c99b63 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:15.024377 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1f984cfc-1353-4815-a8d5-192ba8c99b63 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:15.024846 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1f984cfc-1353-4815-a8d5-192ba8c99b63 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:15.057534 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1f984cfc-1353-4815-a8d5-192ba8c99b63 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:15.058031 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1f984cfc-1353-4815-a8d5-192ba8c99b63 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:15.058473 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1f984cfc-1353-4815-a8d5-192ba8c99b63 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:15.058926 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.objects.instance [None req-1f984cfc-1353-4815-a8d5-192ba8c99b63 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lazy-loading 'fault' on Instance uuid 6b648f87-b6d8-47f4-9633-256c3bed404d {{(pid=127141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 04:44:15.135802 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-1f984cfc-1353-4815-a8d5-192ba8c99b63 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad7c7ccaeef409ebb5af348300068f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb362553bd743bfbbe783296f2597e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:15.146638 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-1f984cfc-1353-4815-a8d5-192ba8c99b63 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "GET /compute/v2.1/servers/6b648f87-b6d8-47f4-9633-256c3bed404d" status: 200 len: 1304 microversion: 2.1 time: 0.137925 Sep 25 04:44:15.149037 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 414/890] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:15 2022] GET /compute/v2.1/servers/6b648f87-b6d8-47f4-9633-256c3bed404d => generated 1304 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:16.171448 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-115d2560-0a4b-41fc-94ba-0c177def108a tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:16.172146 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-115d2560-0a4b-41fc-94ba-0c177def108a tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: 6b648f87-b6d8-47f4-9633-256c3bed404d] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:16.178802 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-115d2560-0a4b-41fc-94ba-0c177def108a tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:16.179291 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-115d2560-0a4b-41fc-94ba-0c177def108a tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:16.179731 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-115d2560-0a4b-41fc-94ba-0c177def108a tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:16.180424 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-115d2560-0a4b-41fc-94ba-0c177def108a tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:16.180907 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-115d2560-0a4b-41fc-94ba-0c177def108a tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:16.181332 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-115d2560-0a4b-41fc-94ba-0c177def108a tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:16.195336 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.wsgi [None req-115d2560-0a4b-41fc-94ba-0c177def108a tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] HTTP exception thrown: Instance 6b648f87-b6d8-47f4-9633-256c3bed404d could not be found. Sep 25 04:44:16.196993 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-115d2560-0a4b-41fc-94ba-0c177def108a tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Request method failure captured: Sep 25 04:44:16.196993 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: request: GET /compute/v2.1/servers/6b648f87-b6d8-47f4-9633-256c3bed404d HTTP/1.1 Sep 25 04:44:16.196993 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept: application/json Sep 25 04:44:16.196993 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept-Encoding: identity Sep 25 04:44:16.196993 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Connection: close Sep 25 04:44:16.196993 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Length: 0 Sep 25 04:44:16.196993 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Type: application/json Sep 25 04:44:16.196993 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Host: 10.222.0.25 Sep 25 04:44:16.196993 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Openstack-System-Scope: None Sep 25 04:44:16.196993 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: User-Agent: python-urllib3/1.26.12 Sep 25 04:44:16.196993 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Auth-Token: gAAAAABjL9yIQAEaxYEnQvD8dL2Cv7aOCJ85qDXIwSnkJTe7lkz0MlTAVJ4-SzpTZ_DXUkL8Z1MtkNYdPzmjPwHc-q22MVX2Pa_lVmtT59sM06ff_GtD32a6587j6lQaI-dJip1-aj8YqgL4lVJQ7vzj0M5n4di7ivCH_dXmNkBovoswys1P3gE Sep 25 04:44:16.196993 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Id: None Sep 25 04:44:16.196993 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Name: None Sep 25 04:44:16.196993 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Identity-Status: Confirmed Sep 25 04:44:16.196993 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Is-Admin-Project: True Sep 25 04:44:16.196993 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Id: default Sep 25 04:44:16.196993 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Name: Default Sep 25 04:44:16.196993 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Id: 8fb362553bd743bfbbe783296f2597e0 Sep 25 04:44:16.196993 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Name: tempest-VolumesActionsTest-1775458542 Sep 25 04:44:16.196993 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Role: reader,member Sep 25 04:44:16.196993 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Roles: reader,member Sep 25 04:44:16.198684 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8fb362553bd743bfbbe783296f2597e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8fb362553bd743bfbbe783296f2597e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8fb362553bd743bfbbe783296f2597e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8fb362553bd743bfbbe783296f2597e0"}]}] Sep 25 04:44:16.198684 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant: tempest-VolumesActionsTest-1775458542 Sep 25 04:44:16.198684 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Id: 8fb362553bd743bfbbe783296f2597e0 Sep 25 04:44:16.198684 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Name: tempest-VolumesActionsTest-1775458542 Sep 25 04:44:16.198684 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User: tempest-VolumesActionsTest-1775458542-project Sep 25 04:44:16.198684 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Id: default Sep 25 04:44:16.198684 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Name: Default Sep 25 04:44:16.198684 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Id: cad7c7ccaeef409ebb5af348300068f5 Sep 25 04:44:16.198684 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Name: tempest-VolumesActionsTest-1775458542-project Sep 25 04:44:16.198684 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: method: > Sep 25 04:44:16.198684 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: exception: Instance 6b648f87-b6d8-47f4-9633-256c3bed404d could not be found. Sep 25 04:44:16.198684 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: action_args: {'id': '6b648f87-b6d8-47f4-9633-256c3bed404d'} Sep 25 04:44:16.199647 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:44:16.199647 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:44:16.199647 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:44:16.199647 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:44:16.199647 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:44:16.199647 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:44:16.199647 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:44:16.199647 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:44:16.199647 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:44:16.199647 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:44:16.199647 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b648f87-b6d8-47f4-9633-256c3bed404d could not be found. Sep 25 04:44:16.199647 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:44:16.199647 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:44:16.199647 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:44:16.199647 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:44:16.199647 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:44:16.199647 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:44:16.199647 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:44:16.199647 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:44:16.199647 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:44:16.201204 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:44:16.201204 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 04:44:16.201204 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 04:44:16.201204 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:44:16.201204 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:44:16.201204 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:44:16.201204 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:44:16.201204 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b648f87-b6d8-47f4-9633-256c3bed404d could not be found. Sep 25 04:44:16.201204 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:44:16.201204 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:44:16.201204 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:44:16.201204 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:44:16.201204 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:44:16.201204 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:44:16.201204 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:44:16.201204 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:44:16.201204 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b648f87-b6d8-47f4-9633-256c3bed404d could not be found. Sep 25 04:44:16.201204 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:44:16.202550 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-115d2560-0a4b-41fc-94ba-0c177def108a tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Returning 404 to user: Instance 6b648f87-b6d8-47f4-9633-256c3bed404d could not be found. {{(pid=127142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:44:16.202550 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-115d2560-0a4b-41fc-94ba-0c177def108a tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "GET /compute/v2.1/servers/6b648f87-b6d8-47f4-9633-256c3bed404d" status: 404 len: 111 microversion: 2.1 time: 0.032385 Sep 25 04:44:16.202550 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 477/891] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:16 2022] GET /compute/v2.1/servers/6b648f87-b6d8-47f4-9633-256c3bed404d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 04:44:16.248877 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-44234c88-177e-4ab4-9733-2b6fdd9ef229 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-416433434", "imageRef": "e5cfdbb2-d0ce-4736-b311-1a3c155844e9", "flavorRef": "452", "networks": [{"uuid": "f8625bfd-62f4-4562-b0e4-5c8d81fc13fb"}]}} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:44:16.302445 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.network.neutron [None req-44234c88-177e-4ab4-9733-2b6fdd9ef229 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] validate_networks() for [('f8625bfd-62f4-4562-b0e4-5c8d81fc13fb', None, None, None, None, None)] {{(pid=127141) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 04:44:16.643766 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-44234c88-177e-4ab4-9733-2b6fdd9ef229 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Flavor limits 0:0:0 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 04:44:16.644188 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-44234c88-177e-4ab4-9733-2b6fdd9ef229 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Image limits 0:0:0 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 04:44:16.644692 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-44234c88-177e-4ab4-9733-2b6fdd9ef229 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Flavor pref 0:0:0 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 04:44:16.645377 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-44234c88-177e-4ab4-9733-2b6fdd9ef229 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Image pref 0:0:0 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 04:44:16.645802 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-44234c88-177e-4ab4-9733-2b6fdd9ef229 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 04:44:16.654628 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-44234c88-177e-4ab4-9733-2b6fdd9ef229 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:16.655101 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-44234c88-177e-4ab4-9733-2b6fdd9ef229 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:16.655526 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-44234c88-177e-4ab4-9733-2b6fdd9ef229 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:16.656242 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-44234c88-177e-4ab4-9733-2b6fdd9ef229 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:16.656728 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-44234c88-177e-4ab4-9733-2b6fdd9ef229 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:16.657203 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-44234c88-177e-4ab4-9733-2b6fdd9ef229 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:16.673541 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.quota [None req-44234c88-177e-4ab4-9733-2b6fdd9ef229 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Getting quotas for project 8fb362553bd743bfbbe783296f2597e0. Resources: {'instances', 'ram', 'cores'} {{(pid=127141) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 04:44:16.678140 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.quota [None req-44234c88-177e-4ab4-9733-2b6fdd9ef229 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Getting quotas for user cad7c7ccaeef409ebb5af348300068f5 and project 8fb362553bd743bfbbe783296f2597e0. Resources: {'instances', 'ram', 'cores'} {{(pid=127141) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 04:44:16.689436 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-44234c88-177e-4ab4-9733-2b6fdd9ef229 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Going to run 1 instances... {{(pid=127141) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 04:44:16.692521 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-44234c88-177e-4ab4-9733-2b6fdd9ef229 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: fe484c8d-549d-47c1-ae95-5c1a834b419e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5cfdbb2-d0ce-4736-b311-1a3c155844e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127141) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 04:44:16.737481 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-44234c88-177e-4ab4-9733-2b6fdd9ef229 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.492398 Sep 25 04:44:16.738121 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 415/892] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 25 04:44:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 04:44:16.749943 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-5a8cc2bd-f503-4fb6-9103-9311d5e29bf9 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:16.750554 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-5a8cc2bd-f503-4fb6-9103-9311d5e29bf9 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: fe484c8d-549d-47c1-ae95-5c1a834b419e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:16.804793 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-5a8cc2bd-f503-4fb6-9103-9311d5e29bf9 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad7c7ccaeef409ebb5af348300068f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb362553bd743bfbbe783296f2597e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:16.811786 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-5a8cc2bd-f503-4fb6-9103-9311d5e29bf9 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "GET /compute/v2.1/servers/fe484c8d-549d-47c1-ae95-5c1a834b419e" status: 200 len: 1213 microversion: 2.1 time: 0.065615 Sep 25 04:44:16.812530 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 478/893] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:16 2022] GET /compute/v2.1/servers/fe484c8d-549d-47c1-ae95-5c1a834b419e => generated 1213 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:17.836413 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-96cd7545-a4d9-4d3d-825c-6c8f30196d14 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:17.837116 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-96cd7545-a4d9-4d3d-825c-6c8f30196d14 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: fe484c8d-549d-47c1-ae95-5c1a834b419e] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:17.843210 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-96cd7545-a4d9-4d3d-825c-6c8f30196d14 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:17.843714 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-96cd7545-a4d9-4d3d-825c-6c8f30196d14 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:17.844129 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-96cd7545-a4d9-4d3d-825c-6c8f30196d14 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:17.844848 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-96cd7545-a4d9-4d3d-825c-6c8f30196d14 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:17.845302 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-96cd7545-a4d9-4d3d-825c-6c8f30196d14 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:17.845725 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-96cd7545-a4d9-4d3d-825c-6c8f30196d14 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:17.906870 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-96cd7545-a4d9-4d3d-825c-6c8f30196d14 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad7c7ccaeef409ebb5af348300068f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb362553bd743bfbbe783296f2597e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:17.915849 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-96cd7545-a4d9-4d3d-825c-6c8f30196d14 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "GET /compute/v2.1/servers/fe484c8d-549d-47c1-ae95-5c1a834b419e" status: 200 len: 1265 microversion: 2.1 time: 0.084418 Sep 25 04:44:17.916680 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 416/894] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:17 2022] GET /compute/v2.1/servers/fe484c8d-549d-47c1-ae95-5c1a834b419e => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:18.940305 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-949cbcf4-8c87-4bc2-9c41-83c5dc92959c tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:18.940948 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-949cbcf4-8c87-4bc2-9c41-83c5dc92959c tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: fe484c8d-549d-47c1-ae95-5c1a834b419e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:18.948579 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-949cbcf4-8c87-4bc2-9c41-83c5dc92959c tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:18.949094 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-949cbcf4-8c87-4bc2-9c41-83c5dc92959c tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:18.949534 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-949cbcf4-8c87-4bc2-9c41-83c5dc92959c tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:18.950225 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-949cbcf4-8c87-4bc2-9c41-83c5dc92959c tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:18.950679 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-949cbcf4-8c87-4bc2-9c41-83c5dc92959c tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:18.951100 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-949cbcf4-8c87-4bc2-9c41-83c5dc92959c tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:19.423875 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-949cbcf4-8c87-4bc2-9c41-83c5dc92959c tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad7c7ccaeef409ebb5af348300068f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb362553bd743bfbbe783296f2597e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:19.432200 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-949cbcf4-8c87-4bc2-9c41-83c5dc92959c tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "GET /compute/v2.1/servers/fe484c8d-549d-47c1-ae95-5c1a834b419e" status: 200 len: 1313 microversion: 2.1 time: 0.495685 Sep 25 04:44:19.433031 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 479/895] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:18 2022] GET /compute/v2.1/servers/fe484c8d-549d-47c1-ae95-5c1a834b419e => generated 1313 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:19.619761 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [req-35403ee8-a070-49f6-a9d0-d7fab442ac96 req-6909d7fb-45fe-48c9-adb8-48e3b88b9a1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe484c8d-549d-47c1-ae95-5c1a834b419e", "tag": "2dc031cb-2966-44a7-9207-4eb9a60e1123"}]} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:44:19.630487 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-35403ee8-a070-49f6-a9d0-d7fab442ac96 req-6909d7fb-45fe-48c9-adb8-48e3b88b9a1d service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:19.631149 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-35403ee8-a070-49f6-a9d0-d7fab442ac96 req-6909d7fb-45fe-48c9-adb8-48e3b88b9a1d service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:19.631621 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-35403ee8-a070-49f6-a9d0-d7fab442ac96 req-6909d7fb-45fe-48c9-adb8-48e3b88b9a1d service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:19.643019 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.compute.server_external_events [req-35403ee8-a070-49f6-a9d0-d7fab442ac96 req-6909d7fb-45fe-48c9-adb8-48e3b88b9a1d service nova] Creating event network-changed:2dc031cb-2966-44a7-9207-4eb9a60e1123 for instance fe484c8d-549d-47c1-ae95-5c1a834b419e on hv-cinder-85535 Sep 25 04:44:19.649103 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [req-35403ee8-a070-49f6-a9d0-d7fab442ac96 req-6909d7fb-45fe-48c9-adb8-48e3b88b9a1d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033082 Sep 25 04:44:19.649703 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 417/896] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:44:20.455208 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-4404f574-3872-4f45-908b-34d02f161d3c tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:20.455819 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-4404f574-3872-4f45-908b-34d02f161d3c tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: fe484c8d-549d-47c1-ae95-5c1a834b419e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:20.462345 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4404f574-3872-4f45-908b-34d02f161d3c tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:20.474344 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4404f574-3872-4f45-908b-34d02f161d3c tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:20.474344 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4404f574-3872-4f45-908b-34d02f161d3c tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:20.474344 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4404f574-3872-4f45-908b-34d02f161d3c tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:20.474344 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4404f574-3872-4f45-908b-34d02f161d3c tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:20.474719 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-4404f574-3872-4f45-908b-34d02f161d3c tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:20.524296 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-9ec6e853-ab9b-4b4d-b3c3-16a07157a9c3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2011865716", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-363590622", "security_groups": [{"name": "tempest-secgroup-smoke-2021890742"}], "block_device_mapping_v2": [{"uuid": "285f6dae-2bc6-414d-a19a-92f360167e81", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fc0edd4f-78eb-4338-9c41-437457efbef1"}]}} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:44:20.606249 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-4404f574-3872-4f45-908b-34d02f161d3c tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad7c7ccaeef409ebb5af348300068f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb362553bd743bfbbe783296f2597e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:20.614129 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-4404f574-3872-4f45-908b-34d02f161d3c tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "GET /compute/v2.1/servers/fe484c8d-549d-47c1-ae95-5c1a834b419e" status: 200 len: 1313 microversion: 2.1 time: 0.162721 Sep 25 04:44:20.615554 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 480/897] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:20 2022] GET /compute/v2.1/servers/fe484c8d-549d-47c1-ae95-5c1a834b419e => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:20.643812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.network.neutron [None req-9ec6e853-ab9b-4b4d-b3c3-16a07157a9c3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] validate_networks() for [('fc0edd4f-78eb-4338-9c41-437457efbef1', None, None, None, None, None)] {{(pid=127141) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 04:44:21.007532 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-9ec6e853-ab9b-4b4d-b3c3-16a07157a9c3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Flavor limits 0:0:0 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 04:44:21.007954 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-9ec6e853-ab9b-4b4d-b3c3-16a07157a9c3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Image limits 0:0:0 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 04:44:21.008428 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-9ec6e853-ab9b-4b4d-b3c3-16a07157a9c3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Flavor pref 0:0:0 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 04:44:21.008865 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-9ec6e853-ab9b-4b4d-b3c3-16a07157a9c3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Image pref 0:0:0 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 04:44:21.009275 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-9ec6e853-ab9b-4b4d-b3c3-16a07157a9c3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 04:44:21.017848 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9ec6e853-ab9b-4b4d-b3c3-16a07157a9c3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:21.018326 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9ec6e853-ab9b-4b4d-b3c3-16a07157a9c3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:21.018755 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9ec6e853-ab9b-4b4d-b3c3-16a07157a9c3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:21.019467 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9ec6e853-ab9b-4b4d-b3c3-16a07157a9c3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:21.019918 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9ec6e853-ab9b-4b4d-b3c3-16a07157a9c3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:21.020337 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9ec6e853-ab9b-4b4d-b3c3-16a07157a9c3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:21.037489 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.quota [None req-9ec6e853-ab9b-4b4d-b3c3-16a07157a9c3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Getting quotas for project 00f66d2c942b419abc8d9d010c5a57f3. Resources: {'instances', 'ram', 'cores'} {{(pid=127141) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 04:44:21.041404 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.quota [None req-9ec6e853-ab9b-4b4d-b3c3-16a07157a9c3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Getting quotas for user 329e3f9810b648218dd45a8b489adb1d and project 00f66d2c942b419abc8d9d010c5a57f3. Resources: {'instances', 'ram', 'cores'} {{(pid=127141) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 04:44:21.096793 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-9ec6e853-ab9b-4b4d-b3c3-16a07157a9c3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Going to run 1 instances... {{(pid=127141) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 04:44:21.099668 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-9ec6e853-ab9b-4b4d-b3c3-16a07157a9c3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: 7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='285f6dae-2bc6-414d-a19a-92f360167e81',volume_size=None,volume_type=None)] {{(pid=127141) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 04:44:21.230980 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-9ec6e853-ab9b-4b4d-b3c3-16a07157a9c3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.711167 Sep 25 04:44:21.231610 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 418/898] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 25 04:44:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 25 04:44:21.242792 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-7cc1785f-6ca2-43f9-a43d-183740793856 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:21.243404 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-7cc1785f-6ca2-43f9-a43d-183740793856 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: 7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:21.296440 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-7cc1785f-6ca2-43f9-a43d-183740793856 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:21.303815 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-7cc1785f-6ca2-43f9-a43d-183740793856 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412" status: 200 len: 1094 microversion: 2.1 time: 0.065027 Sep 25 04:44:21.304385 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 481/899] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:21 2022] GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:21.637902 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-9409598a-971e-4bcf-a3e8-841ff88e5cf1 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:21.638515 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-9409598a-971e-4bcf-a3e8-841ff88e5cf1 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: fe484c8d-549d-47c1-ae95-5c1a834b419e] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:21.645363 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9409598a-971e-4bcf-a3e8-841ff88e5cf1 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:21.646589 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9409598a-971e-4bcf-a3e8-841ff88e5cf1 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:21.646950 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9409598a-971e-4bcf-a3e8-841ff88e5cf1 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:21.647645 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9409598a-971e-4bcf-a3e8-841ff88e5cf1 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:21.648108 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9409598a-971e-4bcf-a3e8-841ff88e5cf1 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:21.648540 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9409598a-971e-4bcf-a3e8-841ff88e5cf1 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:21.779186 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-9409598a-971e-4bcf-a3e8-841ff88e5cf1 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad7c7ccaeef409ebb5af348300068f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb362553bd743bfbbe783296f2597e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:21.787104 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-9409598a-971e-4bcf-a3e8-841ff88e5cf1 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "GET /compute/v2.1/servers/fe484c8d-549d-47c1-ae95-5c1a834b419e" status: 200 len: 1313 microversion: 2.1 time: 0.153183 Sep 25 04:44:21.787663 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 419/900] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:21 2022] GET /compute/v2.1/servers/fe484c8d-549d-47c1-ae95-5c1a834b419e => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:22.326063 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-eca37ee1-2255-43d0-9321-8cd1952bd2c6 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:22.326678 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-eca37ee1-2255-43d0-9321-8cd1952bd2c6 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: 7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:22.334149 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-eca37ee1-2255-43d0-9321-8cd1952bd2c6 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:22.334631 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-eca37ee1-2255-43d0-9321-8cd1952bd2c6 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:22.335066 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-eca37ee1-2255-43d0-9321-8cd1952bd2c6 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:22.335750 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-eca37ee1-2255-43d0-9321-8cd1952bd2c6 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:22.336207 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-eca37ee1-2255-43d0-9321-8cd1952bd2c6 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:22.336629 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-eca37ee1-2255-43d0-9321-8cd1952bd2c6 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:22.395858 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-eca37ee1-2255-43d0-9321-8cd1952bd2c6 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:22.403448 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-eca37ee1-2255-43d0-9321-8cd1952bd2c6 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412" status: 200 len: 1144 microversion: 2.1 time: 0.081291 Sep 25 04:44:22.404034 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 482/901] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:22 2022] GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412 => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:22.810379 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-a7ee8ad1-72f2-463f-b24f-9a33ee5e3c2f tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:22.810993 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-a7ee8ad1-72f2-463f-b24f-9a33ee5e3c2f tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: fe484c8d-549d-47c1-ae95-5c1a834b419e] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:22.817464 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a7ee8ad1-72f2-463f-b24f-9a33ee5e3c2f tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:22.817958 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a7ee8ad1-72f2-463f-b24f-9a33ee5e3c2f tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:22.818948 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a7ee8ad1-72f2-463f-b24f-9a33ee5e3c2f tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:22.819651 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a7ee8ad1-72f2-463f-b24f-9a33ee5e3c2f tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:22.820110 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a7ee8ad1-72f2-463f-b24f-9a33ee5e3c2f tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:22.820544 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a7ee8ad1-72f2-463f-b24f-9a33ee5e3c2f tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:22.946554 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-a7ee8ad1-72f2-463f-b24f-9a33ee5e3c2f tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad7c7ccaeef409ebb5af348300068f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb362553bd743bfbbe783296f2597e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:22.954044 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-a7ee8ad1-72f2-463f-b24f-9a33ee5e3c2f tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "GET /compute/v2.1/servers/fe484c8d-549d-47c1-ae95-5c1a834b419e" status: 200 len: 1313 microversion: 2.1 time: 0.147593 Sep 25 04:44:22.954631 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 420/902] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:22 2022] GET /compute/v2.1/servers/fe484c8d-549d-47c1-ae95-5c1a834b419e => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:23.425818 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-fc0f3a03-f7ce-49b9-9731-8110104d5228 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:23.426481 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-fc0f3a03-f7ce-49b9-9731-8110104d5228 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: 7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:23.434184 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fc0f3a03-f7ce-49b9-9731-8110104d5228 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:23.434674 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fc0f3a03-f7ce-49b9-9731-8110104d5228 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:23.435112 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fc0f3a03-f7ce-49b9-9731-8110104d5228 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:23.435806 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fc0f3a03-f7ce-49b9-9731-8110104d5228 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:23.436270 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fc0f3a03-f7ce-49b9-9731-8110104d5228 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:23.436787 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fc0f3a03-f7ce-49b9-9731-8110104d5228 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:23.525319 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-fc0f3a03-f7ce-49b9-9731-8110104d5228 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:23.532990 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-fc0f3a03-f7ce-49b9-9731-8110104d5228 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412" status: 200 len: 1144 microversion: 2.1 time: 0.111080 Sep 25 04:44:23.533792 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 483/903] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:23 2022] GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412 => generated 1144 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:23.978361 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-c7c27714-1fb6-45ef-adc3-86ba9a81af99 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:23.978900 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-c7c27714-1fb6-45ef-adc3-86ba9a81af99 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: fe484c8d-549d-47c1-ae95-5c1a834b419e] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:23.985372 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c7c27714-1fb6-45ef-adc3-86ba9a81af99 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:23.985875 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c7c27714-1fb6-45ef-adc3-86ba9a81af99 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:23.986298 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c7c27714-1fb6-45ef-adc3-86ba9a81af99 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:23.986984 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c7c27714-1fb6-45ef-adc3-86ba9a81af99 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:23.987440 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c7c27714-1fb6-45ef-adc3-86ba9a81af99 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:23.987905 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c7c27714-1fb6-45ef-adc3-86ba9a81af99 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:24.120665 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-c7c27714-1fb6-45ef-adc3-86ba9a81af99 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad7c7ccaeef409ebb5af348300068f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb362553bd743bfbbe783296f2597e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:24.128359 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-c7c27714-1fb6-45ef-adc3-86ba9a81af99 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "GET /compute/v2.1/servers/fe484c8d-549d-47c1-ae95-5c1a834b419e" status: 200 len: 1313 microversion: 2.1 time: 0.154589 Sep 25 04:44:24.128973 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 421/904] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:23 2022] GET /compute/v2.1/servers/fe484c8d-549d-47c1-ae95-5c1a834b419e => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:24.555847 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-38b310f4-3aef-47d6-8649-db045557cc3c tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:24.556497 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-38b310f4-3aef-47d6-8649-db045557cc3c tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: 7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:24.563113 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-38b310f4-3aef-47d6-8649-db045557cc3c tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:24.563603 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-38b310f4-3aef-47d6-8649-db045557cc3c tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:24.564039 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-38b310f4-3aef-47d6-8649-db045557cc3c tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:24.564791 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-38b310f4-3aef-47d6-8649-db045557cc3c tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:24.565248 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-38b310f4-3aef-47d6-8649-db045557cc3c tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:24.565682 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-38b310f4-3aef-47d6-8649-db045557cc3c tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:24.652168 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-38b310f4-3aef-47d6-8649-db045557cc3c tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:24.659991 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-38b310f4-3aef-47d6-8649-db045557cc3c tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412" status: 200 len: 1210 microversion: 2.1 time: 0.108158 Sep 25 04:44:24.660560 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 484/905] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:24 2022] GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412 => generated 1210 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:25.152084 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-29cb4a8d-8e79-4731-90bc-99dab962cdc5 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:25.152699 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-29cb4a8d-8e79-4731-90bc-99dab962cdc5 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: fe484c8d-549d-47c1-ae95-5c1a834b419e] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:25.155101 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=9 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:44:25.160943 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-29cb4a8d-8e79-4731-90bc-99dab962cdc5 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:25.161436 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-29cb4a8d-8e79-4731-90bc-99dab962cdc5 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:25.162632 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-29cb4a8d-8e79-4731-90bc-99dab962cdc5 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:25.163343 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-29cb4a8d-8e79-4731-90bc-99dab962cdc5 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:25.163798 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-29cb4a8d-8e79-4731-90bc-99dab962cdc5 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:25.164224 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-29cb4a8d-8e79-4731-90bc-99dab962cdc5 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:25.167914 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=97 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:44:25.414670 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-29cb4a8d-8e79-4731-90bc-99dab962cdc5 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad7c7ccaeef409ebb5af348300068f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb362553bd743bfbbe783296f2597e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:25.422730 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-29cb4a8d-8e79-4731-90bc-99dab962cdc5 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "GET /compute/v2.1/servers/fe484c8d-549d-47c1-ae95-5c1a834b419e" status: 200 len: 1313 microversion: 2.1 time: 0.274532 Sep 25 04:44:25.426369 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 422/906] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:25 2022] GET /compute/v2.1/servers/fe484c8d-549d-47c1-ae95-5c1a834b419e => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:25.682805 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-ed7b7e08-9401-4fff-9188-987827185552 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:25.684087 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-ed7b7e08-9401-4fff-9188-987827185552 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: 7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:25.686646 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:44:25.692143 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ed7b7e08-9401-4fff-9188-987827185552 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:25.692661 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ed7b7e08-9401-4fff-9188-987827185552 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:25.693240 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ed7b7e08-9401-4fff-9188-987827185552 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:25.693914 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ed7b7e08-9401-4fff-9188-987827185552 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:25.694370 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ed7b7e08-9401-4fff-9188-987827185552 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:25.694798 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ed7b7e08-9401-4fff-9188-987827185552 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:25.699876 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:44:25.870337 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [req-1bdd6f96-a636-4b88-b197-bfb7c30b9c6b req-d8111dfe-981c-41fe-a2f0-b0d40c508c8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412", "tag": "330880c0-b8c8-4d65-8e80-caa25314c870"}]} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:44:25.881334 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-1bdd6f96-a636-4b88-b197-bfb7c30b9c6b req-d8111dfe-981c-41fe-a2f0-b0d40c508c8c service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:25.882625 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-1bdd6f96-a636-4b88-b197-bfb7c30b9c6b req-d8111dfe-981c-41fe-a2f0-b0d40c508c8c service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:25.883153 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-1bdd6f96-a636-4b88-b197-bfb7c30b9c6b req-d8111dfe-981c-41fe-a2f0-b0d40c508c8c service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:25.895434 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.compute.server_external_events [req-1bdd6f96-a636-4b88-b197-bfb7c30b9c6b req-d8111dfe-981c-41fe-a2f0-b0d40c508c8c service nova] Creating event network-changed:330880c0-b8c8-4d65-8e80-caa25314c870 for instance 7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412 on hv-cinder-85535 Sep 25 04:44:25.901491 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [req-1bdd6f96-a636-4b88-b197-bfb7c30b9c6b req-d8111dfe-981c-41fe-a2f0-b0d40c508c8c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036487 Sep 25 04:44:25.902086 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 423/907] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 04:44:25.922561 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-ed7b7e08-9401-4fff-9188-987827185552 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:25.930461 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-ed7b7e08-9401-4fff-9188-987827185552 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412" status: 200 len: 1266 microversion: 2.1 time: 0.251548 Sep 25 04:44:25.931128 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 485/908] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:25 2022] GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412 => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:26.447909 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-b457ac73-bd27-4914-aa73-ff1f900549ef tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:26.448604 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-b457ac73-bd27-4914-aa73-ff1f900549ef tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: fe484c8d-549d-47c1-ae95-5c1a834b419e] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:26.455300 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b457ac73-bd27-4914-aa73-ff1f900549ef tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:26.455787 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b457ac73-bd27-4914-aa73-ff1f900549ef tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:26.456233 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b457ac73-bd27-4914-aa73-ff1f900549ef tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:26.457043 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b457ac73-bd27-4914-aa73-ff1f900549ef tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:26.457501 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b457ac73-bd27-4914-aa73-ff1f900549ef tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:26.457931 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b457ac73-bd27-4914-aa73-ff1f900549ef tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:26.588428 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-b457ac73-bd27-4914-aa73-ff1f900549ef tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad7c7ccaeef409ebb5af348300068f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb362553bd743bfbbe783296f2597e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:26.596340 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-b457ac73-bd27-4914-aa73-ff1f900549ef tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "GET /compute/v2.1/servers/fe484c8d-549d-47c1-ae95-5c1a834b419e" status: 200 len: 1313 microversion: 2.1 time: 0.153487 Sep 25 04:44:26.596935 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 424/909] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:26 2022] GET /compute/v2.1/servers/fe484c8d-549d-47c1-ae95-5c1a834b419e => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:26.953576 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-d50bc17f-da7f-4e29-a8e3-39cac53f5e7c tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:26.954183 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-d50bc17f-da7f-4e29-a8e3-39cac53f5e7c tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: 7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:26.961138 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d50bc17f-da7f-4e29-a8e3-39cac53f5e7c tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:26.961672 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d50bc17f-da7f-4e29-a8e3-39cac53f5e7c tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:26.962106 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d50bc17f-da7f-4e29-a8e3-39cac53f5e7c tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:26.962783 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d50bc17f-da7f-4e29-a8e3-39cac53f5e7c tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:26.963233 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d50bc17f-da7f-4e29-a8e3-39cac53f5e7c tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:26.963913 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d50bc17f-da7f-4e29-a8e3-39cac53f5e7c tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:27.092227 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-d50bc17f-da7f-4e29-a8e3-39cac53f5e7c tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:27.100584 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-d50bc17f-da7f-4e29-a8e3-39cac53f5e7c tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412" status: 200 len: 1266 microversion: 2.1 time: 0.150872 Sep 25 04:44:27.101779 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 486/910] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:26 2022] GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:27.619644 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-2b353916-f703-4c80-b009-63c86f9c3515 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:27.620255 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-2b353916-f703-4c80-b009-63c86f9c3515 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: fe484c8d-549d-47c1-ae95-5c1a834b419e] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:27.626728 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2b353916-f703-4c80-b009-63c86f9c3515 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:27.627215 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2b353916-f703-4c80-b009-63c86f9c3515 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:27.627655 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2b353916-f703-4c80-b009-63c86f9c3515 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:27.628343 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2b353916-f703-4c80-b009-63c86f9c3515 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:27.628828 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2b353916-f703-4c80-b009-63c86f9c3515 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:27.629258 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2b353916-f703-4c80-b009-63c86f9c3515 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:27.795347 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-2b353916-f703-4c80-b009-63c86f9c3515 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad7c7ccaeef409ebb5af348300068f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb362553bd743bfbbe783296f2597e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:27.804478 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-2b353916-f703-4c80-b009-63c86f9c3515 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "GET /compute/v2.1/servers/fe484c8d-549d-47c1-ae95-5c1a834b419e" status: 200 len: 1313 microversion: 2.1 time: 0.187979 Sep 25 04:44:27.805350 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 425/911] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:27 2022] GET /compute/v2.1/servers/fe484c8d-549d-47c1-ae95-5c1a834b419e => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:27.824424 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-15f93463-fc7d-4b3e-a57f-47c07db03af9 req-74ecbad8-f2c3-4746-937f-752284014980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe484c8d-549d-47c1-ae95-5c1a834b419e", "name": "network-vif-plugged", "status": "completed", "tag": "2dc031cb-2966-44a7-9207-4eb9a60e1123"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:44:27.834916 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-15f93463-fc7d-4b3e-a57f-47c07db03af9 req-74ecbad8-f2c3-4746-937f-752284014980 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:27.835860 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-15f93463-fc7d-4b3e-a57f-47c07db03af9 req-74ecbad8-f2c3-4746-937f-752284014980 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:27.836369 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-15f93463-fc7d-4b3e-a57f-47c07db03af9 req-74ecbad8-f2c3-4746-937f-752284014980 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:27.849466 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-15f93463-fc7d-4b3e-a57f-47c07db03af9 req-74ecbad8-f2c3-4746-937f-752284014980 service nova] Creating event network-vif-plugged:2dc031cb-2966-44a7-9207-4eb9a60e1123 for instance fe484c8d-549d-47c1-ae95-5c1a834b419e on hv-cinder-85535 Sep 25 04:44:27.854603 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-15f93463-fc7d-4b3e-a57f-47c07db03af9 req-74ecbad8-f2c3-4746-937f-752284014980 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035307 Sep 25 04:44:27.855340 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 487/912] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:44:28.123741 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-5d568c6b-95c7-4c98-996a-83e66244ec88 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:28.124261 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-5d568c6b-95c7-4c98-996a-83e66244ec88 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: 7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:28.130352 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5d568c6b-95c7-4c98-996a-83e66244ec88 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:28.130843 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5d568c6b-95c7-4c98-996a-83e66244ec88 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:28.131479 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5d568c6b-95c7-4c98-996a-83e66244ec88 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:28.132068 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5d568c6b-95c7-4c98-996a-83e66244ec88 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:28.132496 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5d568c6b-95c7-4c98-996a-83e66244ec88 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:28.132960 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5d568c6b-95c7-4c98-996a-83e66244ec88 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:28.341194 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-5d568c6b-95c7-4c98-996a-83e66244ec88 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:28.348740 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-5d568c6b-95c7-4c98-996a-83e66244ec88 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412" status: 200 len: 1266 microversion: 2.1 time: 0.228962 Sep 25 04:44:28.349302 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 426/913] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:28 2022] GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412 => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:28.828612 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-df906b30-b5ad-48da-b7c7-c109d689d2f9 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:28.829240 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-df906b30-b5ad-48da-b7c7-c109d689d2f9 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: fe484c8d-549d-47c1-ae95-5c1a834b419e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:28.836356 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-df906b30-b5ad-48da-b7c7-c109d689d2f9 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:28.837420 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-df906b30-b5ad-48da-b7c7-c109d689d2f9 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:28.838197 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-df906b30-b5ad-48da-b7c7-c109d689d2f9 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:28.839753 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-df906b30-b5ad-48da-b7c7-c109d689d2f9 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:28.840485 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-df906b30-b5ad-48da-b7c7-c109d689d2f9 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:28.841267 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-df906b30-b5ad-48da-b7c7-c109d689d2f9 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:28.972014 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-df906b30-b5ad-48da-b7c7-c109d689d2f9 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad7c7ccaeef409ebb5af348300068f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb362553bd743bfbbe783296f2597e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:28.979717 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-df906b30-b5ad-48da-b7c7-c109d689d2f9 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "GET /compute/v2.1/servers/fe484c8d-549d-47c1-ae95-5c1a834b419e" status: 200 len: 1313 microversion: 2.1 time: 0.155767 Sep 25 04:44:28.980278 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 488/914] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:28 2022] GET /compute/v2.1/servers/fe484c8d-549d-47c1-ae95-5c1a834b419e => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:29.371944 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-4ee38a7f-7f3c-4576-acd9-56c9000852f4 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:29.372555 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-4ee38a7f-7f3c-4576-acd9-56c9000852f4 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: 7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:29.378973 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4ee38a7f-7f3c-4576-acd9-56c9000852f4 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:29.379495 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4ee38a7f-7f3c-4576-acd9-56c9000852f4 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:29.379938 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4ee38a7f-7f3c-4576-acd9-56c9000852f4 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:29.380631 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4ee38a7f-7f3c-4576-acd9-56c9000852f4 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:29.381119 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4ee38a7f-7f3c-4576-acd9-56c9000852f4 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:29.381548 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4ee38a7f-7f3c-4576-acd9-56c9000852f4 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:29.513461 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-4ee38a7f-7f3c-4576-acd9-56c9000852f4 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:29.521154 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-4ee38a7f-7f3c-4576-acd9-56c9000852f4 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412" status: 200 len: 1266 microversion: 2.1 time: 0.153148 Sep 25 04:44:29.521717 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 427/915] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:29 2022] GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:30.002551 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-41790a98-1c11-4be4-8d6a-f00c4dcce134 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:30.003190 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-41790a98-1c11-4be4-8d6a-f00c4dcce134 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: fe484c8d-549d-47c1-ae95-5c1a834b419e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:30.009932 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-41790a98-1c11-4be4-8d6a-f00c4dcce134 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:30.010412 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-41790a98-1c11-4be4-8d6a-f00c4dcce134 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:30.010845 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-41790a98-1c11-4be4-8d6a-f00c4dcce134 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:30.011524 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-41790a98-1c11-4be4-8d6a-f00c4dcce134 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:30.011975 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-41790a98-1c11-4be4-8d6a-f00c4dcce134 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:30.012394 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-41790a98-1c11-4be4-8d6a-f00c4dcce134 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:30.377393 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-41790a98-1c11-4be4-8d6a-f00c4dcce134 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad7c7ccaeef409ebb5af348300068f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb362553bd743bfbbe783296f2597e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:30.385547 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-41790a98-1c11-4be4-8d6a-f00c4dcce134 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "GET /compute/v2.1/servers/fe484c8d-549d-47c1-ae95-5c1a834b419e" status: 200 len: 1313 microversion: 2.1 time: 0.386958 Sep 25 04:44:30.386112 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 489/916] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:29 2022] GET /compute/v2.1/servers/fe484c8d-549d-47c1-ae95-5c1a834b419e => generated 1313 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:30.543900 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-9a34254c-dff7-4f0d-9537-aa0e274f811a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:30.544515 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-9a34254c-dff7-4f0d-9537-aa0e274f811a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: 7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:30.550897 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9a34254c-dff7-4f0d-9537-aa0e274f811a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:30.551386 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9a34254c-dff7-4f0d-9537-aa0e274f811a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:30.551824 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9a34254c-dff7-4f0d-9537-aa0e274f811a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:30.552514 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9a34254c-dff7-4f0d-9537-aa0e274f811a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:30.553004 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9a34254c-dff7-4f0d-9537-aa0e274f811a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:30.553437 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9a34254c-dff7-4f0d-9537-aa0e274f811a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:30.743800 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-9a34254c-dff7-4f0d-9537-aa0e274f811a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:30.751745 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-9a34254c-dff7-4f0d-9537-aa0e274f811a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412" status: 200 len: 1266 microversion: 2.1 time: 0.211716 Sep 25 04:44:30.752312 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 428/917] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:30 2022] GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412 => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:31.408810 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-1cd07e7f-edbe-4888-bd4b-2f658b5c6230 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:31.409449 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-1cd07e7f-edbe-4888-bd4b-2f658b5c6230 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: fe484c8d-549d-47c1-ae95-5c1a834b419e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:31.411886 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell0:SELECT=4 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:44:31.417495 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1cd07e7f-edbe-4888-bd4b-2f658b5c6230 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:31.418014 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1cd07e7f-edbe-4888-bd4b-2f658b5c6230 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:31.418452 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1cd07e7f-edbe-4888-bd4b-2f658b5c6230 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:31.419140 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1cd07e7f-edbe-4888-bd4b-2f658b5c6230 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:31.419596 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1cd07e7f-edbe-4888-bd4b-2f658b5c6230 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:31.420017 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1cd07e7f-edbe-4888-bd4b-2f658b5c6230 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:31.551722 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-1cd07e7f-edbe-4888-bd4b-2f658b5c6230 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad7c7ccaeef409ebb5af348300068f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb362553bd743bfbbe783296f2597e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:31.560023 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-1cd07e7f-edbe-4888-bd4b-2f658b5c6230 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "GET /compute/v2.1/servers/fe484c8d-549d-47c1-ae95-5c1a834b419e" status: 200 len: 1313 microversion: 2.1 time: 0.155204 Sep 25 04:44:31.560588 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 490/918] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:31 2022] GET /compute/v2.1/servers/fe484c8d-549d-47c1-ae95-5c1a834b419e => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:31.776291 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-6d23822c-1a2b-4953-8146-89b0f128015e tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:31.778419 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-6d23822c-1a2b-4953-8146-89b0f128015e tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: 7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:31.781839 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell0:SELECT=4 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:44:31.782854 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell0:SELECT=12 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:44:31.789511 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6d23822c-1a2b-4953-8146-89b0f128015e tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:31.790011 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6d23822c-1a2b-4953-8146-89b0f128015e tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:31.790538 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6d23822c-1a2b-4953-8146-89b0f128015e tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:31.791446 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6d23822c-1a2b-4953-8146-89b0f128015e tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:31.791912 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6d23822c-1a2b-4953-8146-89b0f128015e tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:31.792347 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6d23822c-1a2b-4953-8146-89b0f128015e tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:31.934973 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-6d23822c-1a2b-4953-8146-89b0f128015e tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:31.942893 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-6d23822c-1a2b-4953-8146-89b0f128015e tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412" status: 200 len: 1266 microversion: 2.1 time: 0.171264 Sep 25 04:44:31.943459 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 429/919] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:31 2022] GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:32.583984 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-f6e75530-bad0-491e-a819-2bab948a615f tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:32.584600 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-f6e75530-bad0-491e-a819-2bab948a615f tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: fe484c8d-549d-47c1-ae95-5c1a834b419e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:32.592313 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f6e75530-bad0-491e-a819-2bab948a615f tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:32.592826 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f6e75530-bad0-491e-a819-2bab948a615f tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:32.593269 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f6e75530-bad0-491e-a819-2bab948a615f tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:32.593965 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f6e75530-bad0-491e-a819-2bab948a615f tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:32.594422 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f6e75530-bad0-491e-a819-2bab948a615f tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:32.594849 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f6e75530-bad0-491e-a819-2bab948a615f tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:32.634242 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-aba0d287-ec55-47c3-9bb4-419117b7c7cb tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:32.634755 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-aba0d287-ec55-47c3-9bb4-419117b7c7cb tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 3170bd2b-77a7-44d5-b7ae-c4352013e7c9] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:32.640875 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-aba0d287-ec55-47c3-9bb4-419117b7c7cb tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:32.641373 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-aba0d287-ec55-47c3-9bb4-419117b7c7cb tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:32.641813 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-aba0d287-ec55-47c3-9bb4-419117b7c7cb tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:32.642531 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-aba0d287-ec55-47c3-9bb4-419117b7c7cb tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:32.642990 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-aba0d287-ec55-47c3-9bb4-419117b7c7cb tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:32.643416 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-aba0d287-ec55-47c3-9bb4-419117b7c7cb tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:32.669063 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-aba0d287-ec55-47c3-9bb4-419117b7c7cb tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9/ips" status: 200 len: 150 microversion: 2.1 time: 0.039050 Sep 25 04:44:32.676152 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 430/920] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Sep 25 04:44:32 2022] GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 04:44:32.742434 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-f6e75530-bad0-491e-a819-2bab948a615f tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad7c7ccaeef409ebb5af348300068f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb362553bd743bfbbe783296f2597e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:32.751040 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-f6e75530-bad0-491e-a819-2bab948a615f tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "GET /compute/v2.1/servers/fe484c8d-549d-47c1-ae95-5c1a834b419e" status: 200 len: 1497 microversion: 2.1 time: 0.170959 Sep 25 04:44:32.752103 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 491/921] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:32 2022] GET /compute/v2.1/servers/fe484c8d-549d-47c1-ae95-5c1a834b419e => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:32.978634 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-d24972ee-f16e-48c9-b975-b867b4495b00 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:32.979256 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-d24972ee-f16e-48c9-b975-b867b4495b00 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: 7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:32.985566 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d24972ee-f16e-48c9-b975-b867b4495b00 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:32.986225 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d24972ee-f16e-48c9-b975-b867b4495b00 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:32.986828 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d24972ee-f16e-48c9-b975-b867b4495b00 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:32.987769 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d24972ee-f16e-48c9-b975-b867b4495b00 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:32.988321 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d24972ee-f16e-48c9-b975-b867b4495b00 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:32.988932 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d24972ee-f16e-48c9-b975-b867b4495b00 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:33.131569 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-d24972ee-f16e-48c9-b975-b867b4495b00 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:33.139483 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-d24972ee-f16e-48c9-b975-b867b4495b00 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412" status: 200 len: 1266 microversion: 2.1 time: 0.165545 Sep 25 04:44:33.140053 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 431/922] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:32 2022] GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:34.054637 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-81e1440f-259f-4bdb-be5b-3797415533e4 req-bc515a61-a48a-45c5-a60b-4f08b640c6c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412", "name": "network-vif-plugged", "status": "completed", "tag": "330880c0-b8c8-4d65-8e80-caa25314c870"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:44:34.065515 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-81e1440f-259f-4bdb-be5b-3797415533e4 req-bc515a61-a48a-45c5-a60b-4f08b640c6c3 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:34.065988 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-81e1440f-259f-4bdb-be5b-3797415533e4 req-bc515a61-a48a-45c5-a60b-4f08b640c6c3 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:34.066410 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-81e1440f-259f-4bdb-be5b-3797415533e4 req-bc515a61-a48a-45c5-a60b-4f08b640c6c3 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:34.077720 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-81e1440f-259f-4bdb-be5b-3797415533e4 req-bc515a61-a48a-45c5-a60b-4f08b640c6c3 service nova] Creating event network-vif-plugged:330880c0-b8c8-4d65-8e80-caa25314c870 for instance 7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412 on hv-cinder-85535 Sep 25 04:44:34.082447 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-81e1440f-259f-4bdb-be5b-3797415533e4 req-bc515a61-a48a-45c5-a60b-4f08b640c6c3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032331 Sep 25 04:44:34.083062 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 492/923] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:44:34.162375 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-094b6d08-239a-4251-a976-a45387e26141 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:34.163769 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-094b6d08-239a-4251-a976-a45387e26141 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: 7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:34.169742 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-094b6d08-239a-4251-a976-a45387e26141 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:34.170234 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-094b6d08-239a-4251-a976-a45387e26141 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:34.170672 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-094b6d08-239a-4251-a976-a45387e26141 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:34.171375 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-094b6d08-239a-4251-a976-a45387e26141 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:34.171830 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-094b6d08-239a-4251-a976-a45387e26141 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:34.172264 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-094b6d08-239a-4251-a976-a45387e26141 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:34.206322 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-53e76979-03bf-4a0c-ae3e-998fb0b58aae tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:34.206991 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-53e76979-03bf-4a0c-ae3e-998fb0b58aae tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: fe484c8d-549d-47c1-ae95-5c1a834b419e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:34.214418 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-53e76979-03bf-4a0c-ae3e-998fb0b58aae tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:34.214903 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-53e76979-03bf-4a0c-ae3e-998fb0b58aae tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:34.215339 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-53e76979-03bf-4a0c-ae3e-998fb0b58aae tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:34.216068 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-53e76979-03bf-4a0c-ae3e-998fb0b58aae tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:34.216549 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-53e76979-03bf-4a0c-ae3e-998fb0b58aae tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:34.217349 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-53e76979-03bf-4a0c-ae3e-998fb0b58aae tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:34.243100 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-53e76979-03bf-4a0c-ae3e-998fb0b58aae tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: fe484c8d-549d-47c1-ae95-5c1a834b419e] Going to try to terminate instance {{(pid=127142) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 04:44:34.314241 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-094b6d08-239a-4251-a976-a45387e26141 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:34.329415 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-53e76979-03bf-4a0c-ae3e-998fb0b58aae tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fe484c8d-549d-47c1-ae95-5c1a834b419e" status: 204 len: 0 microversion: 2.1 time: 0.126754 Sep 25 04:44:34.329934 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 493/924] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 25 04:44:34 2022] DELETE /compute/v2.1/servers/fe484c8d-549d-47c1-ae95-5c1a834b419e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 25 04:44:34.330158 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-094b6d08-239a-4251-a976-a45387e26141 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412" status: 200 len: 1266 microversion: 2.1 time: 0.171066 Sep 25 04:44:34.330621 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 432/925] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:34 2022] GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:34.341315 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-583ec820-0187-4bb1-9896-da3e9c0d0c25 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:34.342298 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-583ec820-0187-4bb1-9896-da3e9c0d0c25 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: fe484c8d-549d-47c1-ae95-5c1a834b419e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:34.348524 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-583ec820-0187-4bb1-9896-da3e9c0d0c25 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:34.349529 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-583ec820-0187-4bb1-9896-da3e9c0d0c25 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:34.350184 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-583ec820-0187-4bb1-9896-da3e9c0d0c25 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:34.350892 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-583ec820-0187-4bb1-9896-da3e9c0d0c25 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:34.351337 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-583ec820-0187-4bb1-9896-da3e9c0d0c25 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:34.351762 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-583ec820-0187-4bb1-9896-da3e9c0d0c25 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:34.484807 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-583ec820-0187-4bb1-9896-da3e9c0d0c25 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad7c7ccaeef409ebb5af348300068f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb362553bd743bfbbe783296f2597e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:34.493239 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-583ec820-0187-4bb1-9896-da3e9c0d0c25 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "GET /compute/v2.1/servers/fe484c8d-549d-47c1-ae95-5c1a834b419e" status: 200 len: 1503 microversion: 2.1 time: 0.158361 Sep 25 04:44:34.493804 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 494/926] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:34 2022] GET /compute/v2.1/servers/fe484c8d-549d-47c1-ae95-5c1a834b419e => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:35.087090 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-e2ad7349-0213-4ede-9c49-8bba8a24cb9e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53d1a25a-b153-4ad6-a5d6-78799c073987"}} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:44:35.089703 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-e2ad7349-0213-4ede-9c49-8bba8a24cb9e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 3170bd2b-77a7-44d5-b7ae-c4352013e7c9] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:35.095643 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e2ad7349-0213-4ede-9c49-8bba8a24cb9e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:35.096078 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e2ad7349-0213-4ede-9c49-8bba8a24cb9e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:35.096518 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e2ad7349-0213-4ede-9c49-8bba8a24cb9e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:35.097239 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e2ad7349-0213-4ede-9c49-8bba8a24cb9e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:35.097697 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e2ad7349-0213-4ede-9c49-8bba8a24cb9e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:35.098132 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e2ad7349-0213-4ede-9c49-8bba8a24cb9e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:35.353941 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-2f01159c-a5ff-4ec2-b51b-0f075bb6668f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:35.354498 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-2f01159c-a5ff-4ec2-b51b-0f075bb6668f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: 7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:35.360909 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2f01159c-a5ff-4ec2-b51b-0f075bb6668f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:35.361393 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2f01159c-a5ff-4ec2-b51b-0f075bb6668f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:35.361831 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2f01159c-a5ff-4ec2-b51b-0f075bb6668f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:35.362512 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2f01159c-a5ff-4ec2-b51b-0f075bb6668f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:35.362968 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2f01159c-a5ff-4ec2-b51b-0f075bb6668f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:35.363391 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2f01159c-a5ff-4ec2-b51b-0f075bb6668f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:35.495873 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-2f01159c-a5ff-4ec2-b51b-0f075bb6668f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:35.503404 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-2f01159c-a5ff-4ec2-b51b-0f075bb6668f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412" status: 200 len: 1266 microversion: 2.1 time: 0.153598 Sep 25 04:44:35.503955 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 495/927] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:35 2022] GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:44:35.516517 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-dd64809e-e6a4-4f6d-be85-1ce28d5537f4 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:35.517154 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-dd64809e-e6a4-4f6d-be85-1ce28d5537f4 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: fe484c8d-549d-47c1-ae95-5c1a834b419e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:35.522927 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-dd64809e-e6a4-4f6d-be85-1ce28d5537f4 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:35.523410 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-dd64809e-e6a4-4f6d-be85-1ce28d5537f4 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:35.523851 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-dd64809e-e6a4-4f6d-be85-1ce28d5537f4 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:35.524532 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-dd64809e-e6a4-4f6d-be85-1ce28d5537f4 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:35.525013 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-dd64809e-e6a4-4f6d-be85-1ce28d5537f4 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:35.525438 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-dd64809e-e6a4-4f6d-be85-1ce28d5537f4 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:35.713107 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-e2ad7349-0213-4ede-9c49-8bba8a24cb9e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "POST /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.629844 Sep 25 04:44:35.719246 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 433/928] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Sep 25 04:44:35 2022] POST /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9/os-volume_attachments => generated 194 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:44:35.721630 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-dd64809e-e6a4-4f6d-be85-1ce28d5537f4 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad7c7ccaeef409ebb5af348300068f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb362553bd743bfbbe783296f2597e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:35.730083 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-dd64809e-e6a4-4f6d-be85-1ce28d5537f4 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "GET /compute/v2.1/servers/fe484c8d-549d-47c1-ae95-5c1a834b419e" status: 200 len: 1503 microversion: 2.1 time: 0.217240 Sep 25 04:44:35.730653 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 496/929] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:35 2022] GET /compute/v2.1/servers/fe484c8d-549d-47c1-ae95-5c1a834b419e => generated 1503 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:44:36.529009 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-efb4d5d6-d514-419e-9876-3b76c4746275 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:36.529705 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-efb4d5d6-d514-419e-9876-3b76c4746275 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: 7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:36.535838 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-efb4d5d6-d514-419e-9876-3b76c4746275 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:36.536322 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-efb4d5d6-d514-419e-9876-3b76c4746275 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:36.536788 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-efb4d5d6-d514-419e-9876-3b76c4746275 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:36.537469 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-efb4d5d6-d514-419e-9876-3b76c4746275 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:36.538422 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-efb4d5d6-d514-419e-9876-3b76c4746275 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:36.539135 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-efb4d5d6-d514-419e-9876-3b76c4746275 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:36.669225 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-efb4d5d6-d514-419e-9876-3b76c4746275 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:36.676862 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-efb4d5d6-d514-419e-9876-3b76c4746275 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412" status: 200 len: 1266 microversion: 2.1 time: 0.152793 Sep 25 04:44:36.677420 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 434/930] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:36 2022] GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:36.753083 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-f98d2599-bdf1-4211-a120-33b6a3dbb05d tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:36.753633 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-f98d2599-bdf1-4211-a120-33b6a3dbb05d tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: fe484c8d-549d-47c1-ae95-5c1a834b419e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:36.760860 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f98d2599-bdf1-4211-a120-33b6a3dbb05d tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:36.761344 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f98d2599-bdf1-4211-a120-33b6a3dbb05d tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:36.761781 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f98d2599-bdf1-4211-a120-33b6a3dbb05d tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:36.762463 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f98d2599-bdf1-4211-a120-33b6a3dbb05d tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:36.762917 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f98d2599-bdf1-4211-a120-33b6a3dbb05d tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:36.763340 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f98d2599-bdf1-4211-a120-33b6a3dbb05d tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:36.895034 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-f98d2599-bdf1-4211-a120-33b6a3dbb05d tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad7c7ccaeef409ebb5af348300068f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb362553bd743bfbbe783296f2597e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:36.902974 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-f98d2599-bdf1-4211-a120-33b6a3dbb05d tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "GET /compute/v2.1/servers/fe484c8d-549d-47c1-ae95-5c1a834b419e" status: 200 len: 1503 microversion: 2.1 time: 0.153796 Sep 25 04:44:36.903544 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 497/931] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:36 2022] GET /compute/v2.1/servers/fe484c8d-549d-47c1-ae95-5c1a834b419e => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:37.700265 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-e6df0a1b-e1f1-4740-b7ee-0cc77d80f322 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:37.700911 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-e6df0a1b-e1f1-4740-b7ee-0cc77d80f322 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: 7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:37.707639 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e6df0a1b-e1f1-4740-b7ee-0cc77d80f322 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:37.708206 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e6df0a1b-e1f1-4740-b7ee-0cc77d80f322 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:37.708561 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e6df0a1b-e1f1-4740-b7ee-0cc77d80f322 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:37.710466 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e6df0a1b-e1f1-4740-b7ee-0cc77d80f322 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:37.711064 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e6df0a1b-e1f1-4740-b7ee-0cc77d80f322 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:37.711830 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e6df0a1b-e1f1-4740-b7ee-0cc77d80f322 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:37.768924 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-69ab836a-238d-45ac-80f6-7a7446eeb9cd req-9c2b1140-fe6b-4b2a-859b-aa03383db45c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe484c8d-549d-47c1-ae95-5c1a834b419e", "name": "network-vif-deleted", "tag": "2dc031cb-2966-44a7-9207-4eb9a60e1123"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:44:37.779645 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-69ab836a-238d-45ac-80f6-7a7446eeb9cd req-9c2b1140-fe6b-4b2a-859b-aa03383db45c service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:37.780143 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-69ab836a-238d-45ac-80f6-7a7446eeb9cd req-9c2b1140-fe6b-4b2a-859b-aa03383db45c service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:37.780563 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-69ab836a-238d-45ac-80f6-7a7446eeb9cd req-9c2b1140-fe6b-4b2a-859b-aa03383db45c service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:37.792503 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-69ab836a-238d-45ac-80f6-7a7446eeb9cd req-9c2b1140-fe6b-4b2a-859b-aa03383db45c service nova] Creating event network-vif-deleted:2dc031cb-2966-44a7-9207-4eb9a60e1123 for instance fe484c8d-549d-47c1-ae95-5c1a834b419e on hv-cinder-85535 Sep 25 04:44:37.798124 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-69ab836a-238d-45ac-80f6-7a7446eeb9cd req-9c2b1140-fe6b-4b2a-859b-aa03383db45c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032928 Sep 25 04:44:37.798705 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 498/932] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 04:44:37.870863 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-e6df0a1b-e1f1-4740-b7ee-0cc77d80f322 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:37.879132 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-e6df0a1b-e1f1-4740-b7ee-0cc77d80f322 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412" status: 200 len: 1452 microversion: 2.1 time: 0.183436 Sep 25 04:44:37.879768 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 435/933] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:37 2022] GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412 => generated 1452 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:37.905119 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-3d83e92c-3c92-4543-83fe-4172c29607da tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:37.905904 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-3d83e92c-3c92-4543-83fe-4172c29607da tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: 7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:37.912068 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3d83e92c-3c92-4543-83fe-4172c29607da tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:37.912551 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3d83e92c-3c92-4543-83fe-4172c29607da tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:37.913226 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3d83e92c-3c92-4543-83fe-4172c29607da tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:37.914179 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3d83e92c-3c92-4543-83fe-4172c29607da tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:37.914640 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3d83e92c-3c92-4543-83fe-4172c29607da tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:37.915073 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3d83e92c-3c92-4543-83fe-4172c29607da tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:37.926683 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-6e0610f4-1183-4e6a-8249-35a46c6fb487 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:37.927332 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-6e0610f4-1183-4e6a-8249-35a46c6fb487 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: fe484c8d-549d-47c1-ae95-5c1a834b419e] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:37.933722 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6e0610f4-1183-4e6a-8249-35a46c6fb487 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:37.934197 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6e0610f4-1183-4e6a-8249-35a46c6fb487 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:37.934661 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6e0610f4-1183-4e6a-8249-35a46c6fb487 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:37.935312 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6e0610f4-1183-4e6a-8249-35a46c6fb487 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:37.935765 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6e0610f4-1183-4e6a-8249-35a46c6fb487 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:37.936188 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6e0610f4-1183-4e6a-8249-35a46c6fb487 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:38.013739 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-6e0610f4-1183-4e6a-8249-35a46c6fb487 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad7c7ccaeef409ebb5af348300068f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb362553bd743bfbbe783296f2597e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:38.021464 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-6e0610f4-1183-4e6a-8249-35a46c6fb487 tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "GET /compute/v2.1/servers/fe484c8d-549d-47c1-ae95-5c1a834b419e" status: 200 len: 1461 microversion: 2.1 time: 0.098675 Sep 25 04:44:38.022027 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 436/934] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:37 2022] GET /compute/v2.1/servers/fe484c8d-549d-47c1-ae95-5c1a834b419e => generated 1461 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:44:38.073422 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-3d83e92c-3c92-4543-83fe-4172c29607da tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:38.081567 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-3d83e92c-3c92-4543-83fe-4172c29607da tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412" status: 200 len: 1452 microversion: 2.1 time: 0.181257 Sep 25 04:44:38.082155 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 499/935] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:37 2022] GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412 => generated 1452 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:39.045504 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-20bd7bd9-faef-4bc8-b170-df8f9638168d tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:39.046238 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-20bd7bd9-faef-4bc8-b170-df8f9638168d tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] [instance: fe484c8d-549d-47c1-ae95-5c1a834b419e] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:39.053171 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-20bd7bd9-faef-4bc8-b170-df8f9638168d tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:39.053957 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-20bd7bd9-faef-4bc8-b170-df8f9638168d tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:39.054539 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-20bd7bd9-faef-4bc8-b170-df8f9638168d tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:39.055322 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-20bd7bd9-faef-4bc8-b170-df8f9638168d tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:39.055854 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-20bd7bd9-faef-4bc8-b170-df8f9638168d tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:39.056355 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-20bd7bd9-faef-4bc8-b170-df8f9638168d tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:39.071218 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.wsgi [None req-20bd7bd9-faef-4bc8-b170-df8f9638168d tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] HTTP exception thrown: Instance fe484c8d-549d-47c1-ae95-5c1a834b419e could not be found. Sep 25 04:44:39.073012 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-20bd7bd9-faef-4bc8-b170-df8f9638168d tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Request method failure captured: Sep 25 04:44:39.073012 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: request: GET /compute/v2.1/servers/fe484c8d-549d-47c1-ae95-5c1a834b419e HTTP/1.1 Sep 25 04:44:39.073012 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept: application/json Sep 25 04:44:39.073012 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept-Encoding: identity Sep 25 04:44:39.073012 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Connection: close Sep 25 04:44:39.073012 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Length: 0 Sep 25 04:44:39.073012 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Type: application/json Sep 25 04:44:39.073012 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Host: 10.222.0.25 Sep 25 04:44:39.073012 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Openstack-System-Scope: None Sep 25 04:44:39.073012 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: User-Agent: python-urllib3/1.26.12 Sep 25 04:44:39.073012 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Auth-Token: gAAAAABjL9yIQAEaxYEnQvD8dL2Cv7aOCJ85qDXIwSnkJTe7lkz0MlTAVJ4-SzpTZ_DXUkL8Z1MtkNYdPzmjPwHc-q22MVX2Pa_lVmtT59sM06ff_GtD32a6587j6lQaI-dJip1-aj8YqgL4lVJQ7vzj0M5n4di7ivCH_dXmNkBovoswys1P3gE Sep 25 04:44:39.073012 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Id: None Sep 25 04:44:39.073012 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Name: None Sep 25 04:44:39.073012 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Identity-Status: Confirmed Sep 25 04:44:39.073012 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Is-Admin-Project: True Sep 25 04:44:39.073012 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Id: default Sep 25 04:44:39.073012 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Name: Default Sep 25 04:44:39.073012 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Id: 8fb362553bd743bfbbe783296f2597e0 Sep 25 04:44:39.073012 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Name: tempest-VolumesActionsTest-1775458542 Sep 25 04:44:39.073012 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Role: reader,member Sep 25 04:44:39.073012 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Roles: reader,member Sep 25 04:44:39.074670 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8fb362553bd743bfbbe783296f2597e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8fb362553bd743bfbbe783296f2597e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8fb362553bd743bfbbe783296f2597e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8fb362553bd743bfbbe783296f2597e0"}]}] Sep 25 04:44:39.074670 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant: tempest-VolumesActionsTest-1775458542 Sep 25 04:44:39.074670 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Id: 8fb362553bd743bfbbe783296f2597e0 Sep 25 04:44:39.074670 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Name: tempest-VolumesActionsTest-1775458542 Sep 25 04:44:39.074670 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User: tempest-VolumesActionsTest-1775458542-project Sep 25 04:44:39.074670 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Id: default Sep 25 04:44:39.074670 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Name: Default Sep 25 04:44:39.074670 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Id: cad7c7ccaeef409ebb5af348300068f5 Sep 25 04:44:39.074670 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Name: tempest-VolumesActionsTest-1775458542-project Sep 25 04:44:39.074670 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: method: > Sep 25 04:44:39.074670 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: exception: Instance fe484c8d-549d-47c1-ae95-5c1a834b419e could not be found. Sep 25 04:44:39.074670 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: action_args: {'id': 'fe484c8d-549d-47c1-ae95-5c1a834b419e'} Sep 25 04:44:39.075491 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:44:39.075491 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:44:39.075491 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:44:39.075491 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:44:39.075491 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:44:39.075491 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:44:39.075491 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:44:39.075491 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:44:39.075491 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:44:39.075491 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:44:39.075491 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe484c8d-549d-47c1-ae95-5c1a834b419e could not be found. Sep 25 04:44:39.075491 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:44:39.075491 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:44:39.075491 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:44:39.075491 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:44:39.075491 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:44:39.075491 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:44:39.075491 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:44:39.075491 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:44:39.075491 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:44:39.076933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:44:39.076933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 04:44:39.076933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 04:44:39.076933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:44:39.076933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:44:39.076933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:44:39.076933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:44:39.076933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe484c8d-549d-47c1-ae95-5c1a834b419e could not be found. Sep 25 04:44:39.076933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:44:39.076933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:44:39.076933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:44:39.076933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:44:39.076933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:44:39.076933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:44:39.076933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:44:39.076933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:44:39.076933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe484c8d-549d-47c1-ae95-5c1a834b419e could not be found. Sep 25 04:44:39.076933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:44:39.078161 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-20bd7bd9-faef-4bc8-b170-df8f9638168d tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] Returning 404 to user: Instance fe484c8d-549d-47c1-ae95-5c1a834b419e could not be found. {{(pid=127141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:44:39.078161 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-20bd7bd9-faef-4bc8-b170-df8f9638168d tempest-VolumesActionsTest-1775458542 tempest-VolumesActionsTest-1775458542-project] 10.222.0.25 "GET /compute/v2.1/servers/fe484c8d-549d-47c1-ae95-5c1a834b419e" status: 404 len: 111 microversion: 2.1 time: 0.032891 Sep 25 04:44:39.078161 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 437/936] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:39 2022] GET /compute/v2.1/servers/fe484c8d-549d-47c1-ae95-5c1a834b419e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 04:44:40.060345 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-c5e86af3-bc73-42de-8331-97c227a8ffda req-273d7ff6-561d-495e-b325-b4ff06199f5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412", "tag": "330880c0-b8c8-4d65-8e80-caa25314c870"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:44:40.070313 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-c5e86af3-bc73-42de-8331-97c227a8ffda req-273d7ff6-561d-495e-b325-b4ff06199f5c service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:40.070793 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-c5e86af3-bc73-42de-8331-97c227a8ffda req-273d7ff6-561d-495e-b325-b4ff06199f5c service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:40.071225 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-c5e86af3-bc73-42de-8331-97c227a8ffda req-273d7ff6-561d-495e-b325-b4ff06199f5c service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:40.082097 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-c5e86af3-bc73-42de-8331-97c227a8ffda req-273d7ff6-561d-495e-b325-b4ff06199f5c service nova] Creating event network-changed:330880c0-b8c8-4d65-8e80-caa25314c870 for instance 7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412 on hv-cinder-85535 Sep 25 04:44:40.086969 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-c5e86af3-bc73-42de-8331-97c227a8ffda req-273d7ff6-561d-495e-b325-b4ff06199f5c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030266 Sep 25 04:44:40.087753 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 500/937] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:44:46.464581 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-c2157075-3c35-4518-af0b-e958ae218cd6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53d1a25a-b153-4ad6-a5d6-78799c073987"}} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:44:46.467179 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-c2157075-3c35-4518-af0b-e958ae218cd6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 3170bd2b-77a7-44d5-b7ae-c4352013e7c9] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:46.474088 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c2157075-3c35-4518-af0b-e958ae218cd6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:46.474608 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c2157075-3c35-4518-af0b-e958ae218cd6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:46.475043 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c2157075-3c35-4518-af0b-e958ae218cd6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:46.475765 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c2157075-3c35-4518-af0b-e958ae218cd6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:46.476338 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c2157075-3c35-4518-af0b-e958ae218cd6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:46.476843 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c2157075-3c35-4518-af0b-e958ae218cd6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:46.556142 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.wsgi [None req-c2157075-3c35-4518-af0b-e958ae218cd6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] HTTP exception thrown: Invalid volume: volume 53d1a25a-b153-4ad6-a5d6-78799c073987 is already attached to instances: 3170bd2b-77a7-44d5-b7ae-c4352013e7c9 Sep 25 04:44:46.557791 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-c2157075-3c35-4518-af0b-e958ae218cd6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Request method failure captured: Sep 25 04:44:46.557791 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: request: POST /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9/os-volume_attachments HTTP/1.1 Sep 25 04:44:46.557791 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept: application/json Sep 25 04:44:46.557791 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept-Encoding: identity Sep 25 04:44:46.557791 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Connection: close Sep 25 04:44:46.557791 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Length: 74 Sep 25 04:44:46.557791 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Type: application/json Sep 25 04:44:46.557791 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Host: 10.222.0.25 Sep 25 04:44:46.557791 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Openstack-System-Scope: None Sep 25 04:44:46.557791 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: User-Agent: python-urllib3/1.26.12 Sep 25 04:44:46.557791 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Auth-Token: gAAAAABjL9qrZElSae56-vG92SlYq1mROXWpWxGFTOD54wjMJs5cfOlxoWE8oAX6RsHfzZAezv5xiCHlYRD_dbdLKAb4-UUsE_8Gy0JkuMwbWForQ70ZIoDPfES94_73P9FeYeuBsh7sfePpFsox-IWSco1U62FJ77nXfz6wXdXOU1pyUSzZLWo Sep 25 04:44:46.557791 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Id: None Sep 25 04:44:46.557791 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Name: None Sep 25 04:44:46.557791 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Identity-Status: Confirmed Sep 25 04:44:46.557791 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Is-Admin-Project: True Sep 25 04:44:46.557791 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Id: default Sep 25 04:44:46.557791 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Name: Default Sep 25 04:44:46.557791 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Id: 5ead2221f7f54d6cbea9fc086a089342 Sep 25 04:44:46.557791 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Name: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:44:46.557791 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Role: reader,member Sep 25 04:44:46.557791 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Roles: reader,member Sep 25 04:44:46.559412 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5ead2221f7f54d6cbea9fc086a089342"}]}] Sep 25 04:44:46.559412 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:44:46.559412 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Id: 5ead2221f7f54d6cbea9fc086a089342 Sep 25 04:44:46.559412 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:44:46.559412 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User: tempest-AttachVolumeNegativeTest-1212083561-project Sep 25 04:44:46.559412 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Id: default Sep 25 04:44:46.559412 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Name: Default Sep 25 04:44:46.559412 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Id: c50ba6f9a164463eae9a248936e7bf80 Sep 25 04:44:46.559412 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Name: tempest-AttachVolumeNegativeTest-1212083561-project Sep 25 04:44:46.559412 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Sep 25 04:44:46.559412 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: {"volumeAttachment": {"volumeId": "53d1a25a-b153-4ad6-a5d6-78799c073987"}} Sep 25 04:44:46.559412 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: method: > Sep 25 04:44:46.560333 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: exception: Invalid volume: volume 53d1a25a-b153-4ad6-a5d6-78799c073987 is already attached to instances: 3170bd2b-77a7-44d5-b7ae-c4352013e7c9 Sep 25 04:44:46.560333 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: action_args: {'server_id': '3170bd2b-77a7-44d5-b7ae-c4352013e7c9', 'body': {'volumeAttachment': {'volumeId': '53d1a25a-b153-4ad6-a5d6-78799c073987'}}} Sep 25 04:44:46.560333 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:44:46.560333 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:44:46.560333 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 25 04:44:46.560333 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 25 04:44:46.560333 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 25 04:44:46.560333 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 25 04:44:46.560333 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 25 04:44:46.560333 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 25 04:44:46.560333 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 25 04:44:46.560333 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 25 04:44:46.560333 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 25 04:44:46.560333 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 25 04:44:46.560333 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 53d1a25a-b153-4ad6-a5d6-78799c073987 is already attached to instances: 3170bd2b-77a7-44d5-b7ae-c4352013e7c9 Sep 25 04:44:46.560333 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:44:46.560333 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:44:46.560333 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:44:46.560333 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:44:46.561897 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:44:46.561897 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:44:46.561897 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:44:46.561897 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:44:46.561897 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:44:46.561897 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:44:46.561897 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 04:44:46.561897 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 04:44:46.561897 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 04:44:46.561897 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 04:44:46.561897 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 04:44:46.561897 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 04:44:46.561897 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 25 04:44:46.561897 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 25 04:44:46.561897 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 53d1a25a-b153-4ad6-a5d6-78799c073987 is already attached to instances: 3170bd2b-77a7-44d5-b7ae-c4352013e7c9 Sep 25 04:44:46.561897 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:44:46.561897 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:44:46.561897 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:44:46.561897 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:44:46.561897 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:44:46.563493 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:44:46.563493 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:44:46.563493 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:44:46.563493 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 53d1a25a-b153-4ad6-a5d6-78799c073987 is already attached to instances: 3170bd2b-77a7-44d5-b7ae-c4352013e7c9 Sep 25 04:44:46.563493 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:44:46.563493 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-c2157075-3c35-4518-af0b-e958ae218cd6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Returning 400 to user: Invalid volume: volume 53d1a25a-b153-4ad6-a5d6-78799c073987 is already attached to instances: 3170bd2b-77a7-44d5-b7ae-c4352013e7c9 {{(pid=127141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:44:46.563493 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-c2157075-3c35-4518-af0b-e958ae218cd6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "POST /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098964 Sep 25 04:44:46.563493 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 438/938] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Sep 25 04:44:46 2022] POST /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 04:44:46.627355 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-b15e040a-e511-4e2b-9f21-32c874663d34 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:46.628047 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-b15e040a-e511-4e2b-9f21-32c874663d34 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 3170bd2b-77a7-44d5-b7ae-c4352013e7c9] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:46.637178 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b15e040a-e511-4e2b-9f21-32c874663d34 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:46.637856 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b15e040a-e511-4e2b-9f21-32c874663d34 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:46.638475 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b15e040a-e511-4e2b-9f21-32c874663d34 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:46.639419 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b15e040a-e511-4e2b-9f21-32c874663d34 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:46.639966 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b15e040a-e511-4e2b-9f21-32c874663d34 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:46.640609 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b15e040a-e511-4e2b-9f21-32c874663d34 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:46.728153 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.objects.instance [None req-b15e040a-e511-4e2b-9f21-32c874663d34 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lazy-loading 'services' on Instance uuid 3170bd2b-77a7-44d5-b7ae-c4352013e7c9 {{(pid=127142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 04:44:46.801242 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-b15e040a-e511-4e2b-9f21-32c874663d34 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9/os-volume_attachments/53d1a25a-b153-4ad6-a5d6-78799c073987" status: 202 len: 0 microversion: 2.1 time: 0.179931 Sep 25 04:44:46.801841 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 501/939] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Sep 25 04:44:46 2022] DELETE /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9/os-volume_attachments/53d1a25a-b153-4ad6-a5d6-78799c073987 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 04:44:46.811087 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-f23ca81a-3bf2-4e0e-9561-1fdbe908e50d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:46.813508 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-f23ca81a-3bf2-4e0e-9561-1fdbe908e50d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 3170bd2b-77a7-44d5-b7ae-c4352013e7c9] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:46.821580 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f23ca81a-3bf2-4e0e-9561-1fdbe908e50d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:46.822101 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f23ca81a-3bf2-4e0e-9561-1fdbe908e50d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:46.822662 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f23ca81a-3bf2-4e0e-9561-1fdbe908e50d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:46.823375 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f23ca81a-3bf2-4e0e-9561-1fdbe908e50d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:46.823831 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f23ca81a-3bf2-4e0e-9561-1fdbe908e50d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:46.824455 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f23ca81a-3bf2-4e0e-9561-1fdbe908e50d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:46.827563 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:44:46.862808 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-f23ca81a-3bf2-4e0e-9561-1fdbe908e50d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055766 Sep 25 04:44:46.863592 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 439/940] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 25 04:44:46 2022] GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:44:47.876837 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-b20780bd-bea2-492e-9a8e-366f2edea50e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:47.880405 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-b20780bd-bea2-492e-9a8e-366f2edea50e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 3170bd2b-77a7-44d5-b7ae-c4352013e7c9] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:47.889048 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b20780bd-bea2-492e-9a8e-366f2edea50e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:47.889918 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b20780bd-bea2-492e-9a8e-366f2edea50e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:47.890575 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b20780bd-bea2-492e-9a8e-366f2edea50e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:47.891642 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b20780bd-bea2-492e-9a8e-366f2edea50e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:47.892333 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b20780bd-bea2-492e-9a8e-366f2edea50e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:47.893159 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b20780bd-bea2-492e-9a8e-366f2edea50e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:47.917630 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:44:47.931845 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-b20780bd-bea2-492e-9a8e-366f2edea50e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059446 Sep 25 04:44:47.937764 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 502/941] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 25 04:44:47 2022] GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:44:48.945268 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-14c32e8f-b7cd-402b-b5ae-e37502cf0512 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:48.947731 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-14c32e8f-b7cd-402b-b5ae-e37502cf0512 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 3170bd2b-77a7-44d5-b7ae-c4352013e7c9] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:48.955057 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-14c32e8f-b7cd-402b-b5ae-e37502cf0512 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:48.955972 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-14c32e8f-b7cd-402b-b5ae-e37502cf0512 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:48.956881 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-14c32e8f-b7cd-402b-b5ae-e37502cf0512 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:48.957816 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-14c32e8f-b7cd-402b-b5ae-e37502cf0512 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:48.958444 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-14c32e8f-b7cd-402b-b5ae-e37502cf0512 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:48.959094 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-14c32e8f-b7cd-402b-b5ae-e37502cf0512 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:48.995030 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-14c32e8f-b7cd-402b-b5ae-e37502cf0512 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054641 Sep 25 04:44:48.996672 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 440/942] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 25 04:44:48 2022] GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 04:44:49.066060 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-843df464-6ce5-4747-97ad-81119f9daa8e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:49.066629 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-843df464-6ce5-4747-97ad-81119f9daa8e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 3170bd2b-77a7-44d5-b7ae-c4352013e7c9] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:49.074377 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-843df464-6ce5-4747-97ad-81119f9daa8e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:49.074881 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-843df464-6ce5-4747-97ad-81119f9daa8e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:49.075321 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-843df464-6ce5-4747-97ad-81119f9daa8e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:49.076030 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-843df464-6ce5-4747-97ad-81119f9daa8e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:49.076505 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-843df464-6ce5-4747-97ad-81119f9daa8e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:49.076945 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-843df464-6ce5-4747-97ad-81119f9daa8e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:49.105600 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-843df464-6ce5-4747-97ad-81119f9daa8e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 3170bd2b-77a7-44d5-b7ae-c4352013e7c9] Going to try to terminate instance {{(pid=127142) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 04:44:49.196543 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-843df464-6ce5-4747-97ad-81119f9daa8e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9" status: 204 len: 0 microversion: 2.1 time: 0.132955 Sep 25 04:44:49.197877 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 503/943] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 25 04:44:49 2022] DELETE /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 04:44:49.207976 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-f1257020-2083-4cdf-ad65-29ce0739c993 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:49.209076 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-f1257020-2083-4cdf-ad65-29ce0739c993 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 3170bd2b-77a7-44d5-b7ae-c4352013e7c9] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:49.218522 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f1257020-2083-4cdf-ad65-29ce0739c993 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:49.219098 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f1257020-2083-4cdf-ad65-29ce0739c993 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:49.219537 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f1257020-2083-4cdf-ad65-29ce0739c993 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:49.220291 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f1257020-2083-4cdf-ad65-29ce0739c993 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:49.220912 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f1257020-2083-4cdf-ad65-29ce0739c993 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:49.221522 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f1257020-2083-4cdf-ad65-29ce0739c993 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:49.380264 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-f1257020-2083-4cdf-ad65-29ce0739c993 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:49.395481 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-f1257020-2083-4cdf-ad65-29ce0739c993 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9" status: 200 len: 1683 microversion: 2.1 time: 0.192601 Sep 25 04:44:49.400847 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 441/944] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:49 2022] GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9 => generated 1683 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:50.423935 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-09fc1617-8b67-49d8-9d98-ea269cadc2f3 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:50.426353 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-09fc1617-8b67-49d8-9d98-ea269cadc2f3 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 3170bd2b-77a7-44d5-b7ae-c4352013e7c9] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:50.437971 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-09fc1617-8b67-49d8-9d98-ea269cadc2f3 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:50.438886 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-09fc1617-8b67-49d8-9d98-ea269cadc2f3 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:50.440118 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-09fc1617-8b67-49d8-9d98-ea269cadc2f3 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:50.441598 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-09fc1617-8b67-49d8-9d98-ea269cadc2f3 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:50.442405 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-09fc1617-8b67-49d8-9d98-ea269cadc2f3 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:50.443403 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-09fc1617-8b67-49d8-9d98-ea269cadc2f3 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:50.633258 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-09fc1617-8b67-49d8-9d98-ea269cadc2f3 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:50.643438 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-09fc1617-8b67-49d8-9d98-ea269cadc2f3 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9" status: 200 len: 1683 microversion: 2.1 time: 0.226707 Sep 25 04:44:50.644483 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 504/945] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:50 2022] GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9 => generated 1683 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:51.673003 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-b45bbff6-4989-4ec7-9a1f-58eea7d2acff tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:51.674344 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-b45bbff6-4989-4ec7-9a1f-58eea7d2acff tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 3170bd2b-77a7-44d5-b7ae-c4352013e7c9] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:51.681750 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b45bbff6-4989-4ec7-9a1f-58eea7d2acff tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:51.682516 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b45bbff6-4989-4ec7-9a1f-58eea7d2acff tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:51.683231 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b45bbff6-4989-4ec7-9a1f-58eea7d2acff tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:51.684053 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b45bbff6-4989-4ec7-9a1f-58eea7d2acff tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:51.684578 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b45bbff6-4989-4ec7-9a1f-58eea7d2acff tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:51.685101 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b45bbff6-4989-4ec7-9a1f-58eea7d2acff tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:51.839358 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-b45bbff6-4989-4ec7-9a1f-58eea7d2acff tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:51.847855 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-b45bbff6-4989-4ec7-9a1f-58eea7d2acff tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9" status: 200 len: 1683 microversion: 2.1 time: 0.178727 Sep 25 04:44:51.848584 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 442/946] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:51 2022] GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9 => generated 1683 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:52.822924 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-dc7c8e72-41fa-4056-bf2b-d3540f809634 req-7063d87c-4c96-4a80-ae86-e7bc6366077f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3170bd2b-77a7-44d5-b7ae-c4352013e7c9", "name": "network-vif-deleted", "tag": "aa510891-580c-4ef4-bb76-929629ee9d1d"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:44:52.842294 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-dc7c8e72-41fa-4056-bf2b-d3540f809634 req-7063d87c-4c96-4a80-ae86-e7bc6366077f service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:52.842782 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-dc7c8e72-41fa-4056-bf2b-d3540f809634 req-7063d87c-4c96-4a80-ae86-e7bc6366077f service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:52.843206 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-dc7c8e72-41fa-4056-bf2b-d3540f809634 req-7063d87c-4c96-4a80-ae86-e7bc6366077f service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:52.872631 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-dc7c8e72-41fa-4056-bf2b-d3540f809634 req-7063d87c-4c96-4a80-ae86-e7bc6366077f service nova] Creating event network-vif-deleted:aa510891-580c-4ef4-bb76-929629ee9d1d for instance 3170bd2b-77a7-44d5-b7ae-c4352013e7c9 on hv-cinder-85535 Sep 25 04:44:52.875293 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-2b025e1c-3dd5-4029-a90a-7c330c18e708 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:52.876158 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-2b025e1c-3dd5-4029-a90a-7c330c18e708 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 3170bd2b-77a7-44d5-b7ae-c4352013e7c9] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:52.890494 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-dc7c8e72-41fa-4056-bf2b-d3540f809634 req-7063d87c-4c96-4a80-ae86-e7bc6366077f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071877 Sep 25 04:44:52.891885 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 505/947] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:44:52.898118 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2b025e1c-3dd5-4029-a90a-7c330c18e708 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:52.898725 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2b025e1c-3dd5-4029-a90a-7c330c18e708 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:52.899276 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2b025e1c-3dd5-4029-a90a-7c330c18e708 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:52.900433 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2b025e1c-3dd5-4029-a90a-7c330c18e708 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:52.901032 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2b025e1c-3dd5-4029-a90a-7c330c18e708 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:52.901568 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2b025e1c-3dd5-4029-a90a-7c330c18e708 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:52.996225 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-2b025e1c-3dd5-4029-a90a-7c330c18e708 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:53.005233 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-2b025e1c-3dd5-4029-a90a-7c330c18e708 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9" status: 200 len: 1327 microversion: 2.1 time: 0.134383 Sep 25 04:44:53.006134 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 443/948] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:52 2022] GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9 => generated 1327 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:54.035410 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-6cc29036-8e97-42a3-a6ea-fd0805132535 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:54.036587 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-6cc29036-8e97-42a3-a6ea-fd0805132535 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 3170bd2b-77a7-44d5-b7ae-c4352013e7c9] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:54.045939 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6cc29036-8e97-42a3-a6ea-fd0805132535 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:54.046832 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6cc29036-8e97-42a3-a6ea-fd0805132535 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:54.047652 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6cc29036-8e97-42a3-a6ea-fd0805132535 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:54.048796 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6cc29036-8e97-42a3-a6ea-fd0805132535 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:54.049894 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6cc29036-8e97-42a3-a6ea-fd0805132535 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:54.051847 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6cc29036-8e97-42a3-a6ea-fd0805132535 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:54.067555 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.wsgi [None req-6cc29036-8e97-42a3-a6ea-fd0805132535 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] HTTP exception thrown: Instance 3170bd2b-77a7-44d5-b7ae-c4352013e7c9 could not be found. Sep 25 04:44:54.071001 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-6cc29036-8e97-42a3-a6ea-fd0805132535 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Request method failure captured: Sep 25 04:44:54.071001 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: request: GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9 HTTP/1.1 Sep 25 04:44:54.071001 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept: application/json Sep 25 04:44:54.071001 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept-Encoding: identity Sep 25 04:44:54.071001 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Connection: close Sep 25 04:44:54.071001 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Length: 0 Sep 25 04:44:54.071001 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Type: application/json Sep 25 04:44:54.071001 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Host: 10.222.0.25 Sep 25 04:44:54.071001 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Openstack-System-Scope: None Sep 25 04:44:54.071001 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: User-Agent: python-urllib3/1.26.12 Sep 25 04:44:54.071001 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Auth-Token: gAAAAABjL9qrZElSae56-vG92SlYq1mROXWpWxGFTOD54wjMJs5cfOlxoWE8oAX6RsHfzZAezv5xiCHlYRD_dbdLKAb4-UUsE_8Gy0JkuMwbWForQ70ZIoDPfES94_73P9FeYeuBsh7sfePpFsox-IWSco1U62FJ77nXfz6wXdXOU1pyUSzZLWo Sep 25 04:44:54.071001 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Id: None Sep 25 04:44:54.071001 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Name: None Sep 25 04:44:54.071001 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Identity-Status: Confirmed Sep 25 04:44:54.071001 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Is-Admin-Project: True Sep 25 04:44:54.071001 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Id: default Sep 25 04:44:54.071001 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Name: Default Sep 25 04:44:54.071001 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Id: 5ead2221f7f54d6cbea9fc086a089342 Sep 25 04:44:54.071001 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Name: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:44:54.071001 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Role: reader,member Sep 25 04:44:54.071001 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Roles: reader,member Sep 25 04:44:54.072390 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5ead2221f7f54d6cbea9fc086a089342"}]}] Sep 25 04:44:54.072390 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:44:54.072390 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Id: 5ead2221f7f54d6cbea9fc086a089342 Sep 25 04:44:54.072390 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:44:54.072390 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User: tempest-AttachVolumeNegativeTest-1212083561-project Sep 25 04:44:54.072390 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Id: default Sep 25 04:44:54.072390 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Name: Default Sep 25 04:44:54.072390 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Id: c50ba6f9a164463eae9a248936e7bf80 Sep 25 04:44:54.072390 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Name: tempest-AttachVolumeNegativeTest-1212083561-project Sep 25 04:44:54.072390 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: method: > Sep 25 04:44:54.072390 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: exception: Instance 3170bd2b-77a7-44d5-b7ae-c4352013e7c9 could not be found. Sep 25 04:44:54.072390 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: action_args: {'id': '3170bd2b-77a7-44d5-b7ae-c4352013e7c9'} Sep 25 04:44:54.073208 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:44:54.073208 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:44:54.073208 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:44:54.073208 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:44:54.073208 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:44:54.073208 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:44:54.073208 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:44:54.073208 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:44:54.073208 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:44:54.073208 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:44:54.073208 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3170bd2b-77a7-44d5-b7ae-c4352013e7c9 could not be found. Sep 25 04:44:54.073208 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:44:54.073208 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:44:54.073208 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:44:54.073208 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:44:54.073208 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:44:54.073208 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:44:54.073208 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:44:54.073208 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:44:54.073208 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:44:54.074447 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:44:54.074447 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 04:44:54.074447 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 04:44:54.074447 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:44:54.074447 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:44:54.074447 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:44:54.074447 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:44:54.074447 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3170bd2b-77a7-44d5-b7ae-c4352013e7c9 could not be found. Sep 25 04:44:54.074447 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:44:54.074447 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:44:54.074447 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:44:54.074447 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:44:54.074447 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:44:54.074447 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:44:54.074447 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:44:54.074447 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:44:54.074447 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3170bd2b-77a7-44d5-b7ae-c4352013e7c9 could not be found. Sep 25 04:44:54.074447 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:44:54.077091 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-6cc29036-8e97-42a3-a6ea-fd0805132535 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Returning 404 to user: Instance 3170bd2b-77a7-44d5-b7ae-c4352013e7c9 could not be found. {{(pid=127142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:44:54.078240 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-6cc29036-8e97-42a3-a6ea-fd0805132535 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9" status: 404 len: 111 microversion: 2.1 time: 0.050640 Sep 25 04:44:54.082823 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 506/949] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:54 2022] GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 04:44:54.088043 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-4e5cef0f-32ce-4614-92b5-0c2f4c2d1be3 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '.version_select at 0x7f4d3ec794c0>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:54.121102 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-4e5cef0f-32ce-4614-92b5-0c2f4c2d1be3 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1522292259" status: 202 len: 0 microversion: 2.1 time: 0.037299 Sep 25 04:44:54.121828 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 444/950] 10.222.0.25 () {58 vars in 1221 bytes} [Sun Sep 25 04:44:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1522292259 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 04:44:54.920430 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-3ffe9efd-bac4-4511-be3d-e0d000da0ac6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Action: 'create', calling method: .version_select at 0x7f4d3ec2eca0>, body: {"keypair": {"name": "tempest-keypair-565036881", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDv9H2o7mEIsKhkTzCFmSiBAZ4QctqaDTDB4XPMlmpTUUSH+W9iuUq3zlPIYsTBZIKA9QTl1xCSgI1Jz7PTlKAXb7+LXtlqeIRRSHyZkkp/nfLMk7Pb2NddnQNCvJrGT7w=="}} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:44:54.937207 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.quota [None req-3ffe9efd-bac4-4511-be3d-e0d000da0ac6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Getting quotas for project 5ead2221f7f54d6cbea9fc086a089342. Resources: {'key_pairs'} {{(pid=127142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 04:44:54.941105 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.quota [None req-3ffe9efd-bac4-4511-be3d-e0d000da0ac6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Getting quotas for user c50ba6f9a164463eae9a248936e7bf80 and project 5ead2221f7f54d6cbea9fc086a089342. Resources: {'key_pairs'} {{(pid=127142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 04:44:54.970178 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-3ffe9efd-bac4-4511-be3d-e0d000da0ac6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052391 Sep 25 04:44:54.970788 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 507/951] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 25 04:44:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:44:56.660254 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-eac1a213-b241-47a3-a565-d90dd447b2ba tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1252407454", "imageRef": "e5cfdbb2-d0ce-4736-b311-1a3c155844e9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4d931b43-9f4d-4494-b9d1-d242cc1f110c"}], "security_groups": [{"name": "tempest-securitygroup--2028776134"}], "key_name": "tempest-keypair-565036881", "user_data": "}} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:44:56.671440 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:44:56.771416 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.network.neutron [None req-eac1a213-b241-47a3-a565-d90dd447b2ba tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] validate_networks() for [('4d931b43-9f4d-4494-b9d1-d242cc1f110c', None, None, None, None, None)] {{(pid=127141) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 04:44:57.258696 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-eac1a213-b241-47a3-a565-d90dd447b2ba tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Flavor limits 0:0:0 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 04:44:57.259487 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-eac1a213-b241-47a3-a565-d90dd447b2ba tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Image limits 0:0:0 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 04:44:57.260157 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-eac1a213-b241-47a3-a565-d90dd447b2ba tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Flavor pref 0:0:0 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 04:44:57.260934 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-eac1a213-b241-47a3-a565-d90dd447b2ba tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Image pref 0:0:0 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 04:44:57.261710 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-eac1a213-b241-47a3-a565-d90dd447b2ba tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 04:44:57.272134 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-eac1a213-b241-47a3-a565-d90dd447b2ba tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:57.272621 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-eac1a213-b241-47a3-a565-d90dd447b2ba tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:57.273410 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-eac1a213-b241-47a3-a565-d90dd447b2ba tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:57.274171 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-eac1a213-b241-47a3-a565-d90dd447b2ba tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:57.274621 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-eac1a213-b241-47a3-a565-d90dd447b2ba tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:57.275049 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-eac1a213-b241-47a3-a565-d90dd447b2ba tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:57.295521 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.quota [None req-eac1a213-b241-47a3-a565-d90dd447b2ba tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Getting quotas for project 5ead2221f7f54d6cbea9fc086a089342. Resources: {'instances', 'ram', 'cores'} {{(pid=127141) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 04:44:57.300750 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.quota [None req-eac1a213-b241-47a3-a565-d90dd447b2ba tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Getting quotas for user c50ba6f9a164463eae9a248936e7bf80 and project 5ead2221f7f54d6cbea9fc086a089342. Resources: {'instances', 'ram', 'cores'} {{(pid=127141) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 04:44:57.314074 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-eac1a213-b241-47a3-a565-d90dd447b2ba tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Going to run 1 instances... {{(pid=127141) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 04:44:57.316743 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-eac1a213-b241-47a3-a565-d90dd447b2ba tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 180dceb1-3b97-4345-b83b-6af39eea407d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5cfdbb2-d0ce-4736-b311-1a3c155844e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127141) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 04:44:57.399928 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-eac1a213-b241-47a3-a565-d90dd447b2ba tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.745580 Sep 25 04:44:57.401296 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 445/952] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 25 04:44:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 04:44:57.413778 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-6767d82b-bfb4-445f-9875-5cb4d3b03b2d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:57.414587 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-6767d82b-bfb4-445f-9875-5cb4d3b03b2d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 180dceb1-3b97-4345-b83b-6af39eea407d] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:57.423296 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:44:57.496371 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-6767d82b-bfb4-445f-9875-5cb4d3b03b2d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:57.503606 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-6767d82b-bfb4-445f-9875-5cb4d3b03b2d tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d" status: 200 len: 1241 microversion: 2.1 time: 0.095234 Sep 25 04:44:57.504179 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 508/953] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:57 2022] GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d => generated 1241 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:58.527008 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-1c51b6f5-0a6b-40ee-a619-55a0da306f1e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:58.527729 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-1c51b6f5-0a6b-40ee-a619-55a0da306f1e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 180dceb1-3b97-4345-b83b-6af39eea407d] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:58.534226 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1c51b6f5-0a6b-40ee-a619-55a0da306f1e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:58.534953 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1c51b6f5-0a6b-40ee-a619-55a0da306f1e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:58.535429 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1c51b6f5-0a6b-40ee-a619-55a0da306f1e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:58.536157 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1c51b6f5-0a6b-40ee-a619-55a0da306f1e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:58.536556 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1c51b6f5-0a6b-40ee-a619-55a0da306f1e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:58.537013 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1c51b6f5-0a6b-40ee-a619-55a0da306f1e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:58.611524 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-1c51b6f5-0a6b-40ee-a619-55a0da306f1e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:58.619878 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-1c51b6f5-0a6b-40ee-a619-55a0da306f1e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d" status: 200 len: 1293 microversion: 2.1 time: 0.097365 Sep 25 04:44:58.620767 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 446/954] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:58 2022] GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d => generated 1293 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:44:59.647151 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-e1bd2890-9af8-4f7a-9e04-5f4393ad8e75 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:44:59.648039 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-e1bd2890-9af8-4f7a-9e04-5f4393ad8e75 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 180dceb1-3b97-4345-b83b-6af39eea407d] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:44:59.660917 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e1bd2890-9af8-4f7a-9e04-5f4393ad8e75 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:59.661480 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e1bd2890-9af8-4f7a-9e04-5f4393ad8e75 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:59.662194 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e1bd2890-9af8-4f7a-9e04-5f4393ad8e75 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:59.663949 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e1bd2890-9af8-4f7a-9e04-5f4393ad8e75 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:44:59.665754 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e1bd2890-9af8-4f7a-9e04-5f4393ad8e75 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:44:59.669103 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e1bd2890-9af8-4f7a-9e04-5f4393ad8e75 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:44:59.767123 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-e1bd2890-9af8-4f7a-9e04-5f4393ad8e75 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:44:59.776594 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-e1bd2890-9af8-4f7a-9e04-5f4393ad8e75 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d" status: 200 len: 1299 microversion: 2.1 time: 0.133444 Sep 25 04:44:59.778838 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 509/955] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:44:59 2022] GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d => generated 1299 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:45:00.806508 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-2784fe75-e0e3-4e59-919c-6592253af214 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:00.808114 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-2784fe75-e0e3-4e59-919c-6592253af214 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 180dceb1-3b97-4345-b83b-6af39eea407d] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:00.817087 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2784fe75-e0e3-4e59-919c-6592253af214 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:00.818206 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2784fe75-e0e3-4e59-919c-6592253af214 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:00.819012 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2784fe75-e0e3-4e59-919c-6592253af214 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:00.819941 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2784fe75-e0e3-4e59-919c-6592253af214 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:00.820821 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2784fe75-e0e3-4e59-919c-6592253af214 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:00.821601 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2784fe75-e0e3-4e59-919c-6592253af214 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:01.070989 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-2784fe75-e0e3-4e59-919c-6592253af214 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:01.080965 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-2784fe75-e0e3-4e59-919c-6592253af214 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d" status: 200 len: 1367 microversion: 2.1 time: 0.279703 Sep 25 04:45:01.082441 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 447/956] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:45:00 2022] GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d => generated 1367 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:45:01.104102 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-a73bbf3e-3d83-48f3-b03c-2f4e97bbeea6 req-eccfe116-59e0-405a-a4a0-0f190679a6c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "180dceb1-3b97-4345-b83b-6af39eea407d", "tag": "18e015bb-0b7a-4eba-89bb-5e64e021a546"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:45:01.127186 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-a73bbf3e-3d83-48f3-b03c-2f4e97bbeea6 req-eccfe116-59e0-405a-a4a0-0f190679a6c3 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:01.127664 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-a73bbf3e-3d83-48f3-b03c-2f4e97bbeea6 req-eccfe116-59e0-405a-a4a0-0f190679a6c3 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:01.129949 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-a73bbf3e-3d83-48f3-b03c-2f4e97bbeea6 req-eccfe116-59e0-405a-a4a0-0f190679a6c3 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:01.146323 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-a73bbf3e-3d83-48f3-b03c-2f4e97bbeea6 req-eccfe116-59e0-405a-a4a0-0f190679a6c3 service nova] Creating event network-changed:18e015bb-0b7a-4eba-89bb-5e64e021a546 for instance 180dceb1-3b97-4345-b83b-6af39eea407d on hv-cinder-85535 Sep 25 04:45:01.153574 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-a73bbf3e-3d83-48f3-b03c-2f4e97bbeea6 req-eccfe116-59e0-405a-a4a0-0f190679a6c3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053305 Sep 25 04:45:01.156890 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 510/957] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:45:02.109839 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-09ad9fd9-04c5-41de-8b20-9af78ff2826e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:02.110626 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-09ad9fd9-04c5-41de-8b20-9af78ff2826e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 180dceb1-3b97-4345-b83b-6af39eea407d] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:02.123402 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-09ad9fd9-04c5-41de-8b20-9af78ff2826e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:02.124217 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-09ad9fd9-04c5-41de-8b20-9af78ff2826e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:02.125112 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-09ad9fd9-04c5-41de-8b20-9af78ff2826e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:02.126958 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-09ad9fd9-04c5-41de-8b20-9af78ff2826e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:02.127542 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-09ad9fd9-04c5-41de-8b20-9af78ff2826e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:02.128335 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-09ad9fd9-04c5-41de-8b20-9af78ff2826e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:02.297666 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-09ad9fd9-04c5-41de-8b20-9af78ff2826e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:02.309558 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-09ad9fd9-04c5-41de-8b20-9af78ff2826e tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d" status: 200 len: 1367 microversion: 2.1 time: 0.204847 Sep 25 04:45:02.310434 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 448/958] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:45:02 2022] GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:45:03.340541 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-0f595be2-747b-4368-a07d-21766f37fa9f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:03.341179 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-0f595be2-747b-4368-a07d-21766f37fa9f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 180dceb1-3b97-4345-b83b-6af39eea407d] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:03.347778 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0f595be2-747b-4368-a07d-21766f37fa9f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:03.348253 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0f595be2-747b-4368-a07d-21766f37fa9f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:03.348704 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0f595be2-747b-4368-a07d-21766f37fa9f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:03.349394 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0f595be2-747b-4368-a07d-21766f37fa9f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:03.350338 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0f595be2-747b-4368-a07d-21766f37fa9f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:03.351042 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0f595be2-747b-4368-a07d-21766f37fa9f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:03.478254 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-0f595be2-747b-4368-a07d-21766f37fa9f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:03.486096 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-0f595be2-747b-4368-a07d-21766f37fa9f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d" status: 200 len: 1367 microversion: 2.1 time: 0.150067 Sep 25 04:45:03.486698 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 511/959] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:45:03 2022] GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:45:04.510357 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-364479bd-9805-498a-9e1c-8c1c185bf42b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:04.510961 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-364479bd-9805-498a-9e1c-8c1c185bf42b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 180dceb1-3b97-4345-b83b-6af39eea407d] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:04.517359 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-364479bd-9805-498a-9e1c-8c1c185bf42b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:04.517843 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-364479bd-9805-498a-9e1c-8c1c185bf42b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:04.518274 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-364479bd-9805-498a-9e1c-8c1c185bf42b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:04.518955 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-364479bd-9805-498a-9e1c-8c1c185bf42b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:04.519405 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-364479bd-9805-498a-9e1c-8c1c185bf42b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:04.519826 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-364479bd-9805-498a-9e1c-8c1c185bf42b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:04.651249 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-364479bd-9805-498a-9e1c-8c1c185bf42b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:04.658955 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-364479bd-9805-498a-9e1c-8c1c185bf42b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d" status: 200 len: 1367 microversion: 2.1 time: 0.153184 Sep 25 04:45:04.659517 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 449/960] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:45:04 2022] GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:45:05.684371 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-ed5e717c-be73-45d0-a8ac-d8cb69741ca6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:05.685326 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-ed5e717c-be73-45d0-a8ac-d8cb69741ca6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 180dceb1-3b97-4345-b83b-6af39eea407d] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:05.692503 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ed5e717c-be73-45d0-a8ac-d8cb69741ca6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:05.693034 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ed5e717c-be73-45d0-a8ac-d8cb69741ca6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:05.693924 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ed5e717c-be73-45d0-a8ac-d8cb69741ca6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:05.694635 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ed5e717c-be73-45d0-a8ac-d8cb69741ca6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:05.695098 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ed5e717c-be73-45d0-a8ac-d8cb69741ca6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:05.695528 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ed5e717c-be73-45d0-a8ac-d8cb69741ca6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:05.831442 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-ed5e717c-be73-45d0-a8ac-d8cb69741ca6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:05.840416 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-ed5e717c-be73-45d0-a8ac-d8cb69741ca6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d" status: 200 len: 1367 microversion: 2.1 time: 0.162170 Sep 25 04:45:05.841686 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 512/961] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:45:05 2022] GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:45:06.863140 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-4e0b8d66-c1ea-4643-a8af-0e337470a63c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:06.863752 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-4e0b8d66-c1ea-4643-a8af-0e337470a63c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 180dceb1-3b97-4345-b83b-6af39eea407d] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:06.871541 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4e0b8d66-c1ea-4643-a8af-0e337470a63c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:06.872028 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4e0b8d66-c1ea-4643-a8af-0e337470a63c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:06.872460 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4e0b8d66-c1ea-4643-a8af-0e337470a63c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:06.873186 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4e0b8d66-c1ea-4643-a8af-0e337470a63c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:06.873847 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4e0b8d66-c1ea-4643-a8af-0e337470a63c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:06.874463 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4e0b8d66-c1ea-4643-a8af-0e337470a63c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:06.935626 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-60e7fe0d-c0e3-4852-809c-c9de210e9a78 req-3df2e9a9-8308-46c1-855d-ce6fa46b2fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "180dceb1-3b97-4345-b83b-6af39eea407d", "name": "network-vif-plugged", "status": "completed", "tag": "18e015bb-0b7a-4eba-89bb-5e64e021a546"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:45:06.950897 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-60e7fe0d-c0e3-4852-809c-c9de210e9a78 req-3df2e9a9-8308-46c1-855d-ce6fa46b2fd2 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:06.951030 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-60e7fe0d-c0e3-4852-809c-c9de210e9a78 req-3df2e9a9-8308-46c1-855d-ce6fa46b2fd2 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:06.951424 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-60e7fe0d-c0e3-4852-809c-c9de210e9a78 req-3df2e9a9-8308-46c1-855d-ce6fa46b2fd2 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:06.967112 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-60e7fe0d-c0e3-4852-809c-c9de210e9a78 req-3df2e9a9-8308-46c1-855d-ce6fa46b2fd2 service nova] Creating event network-vif-plugged:18e015bb-0b7a-4eba-89bb-5e64e021a546 for instance 180dceb1-3b97-4345-b83b-6af39eea407d on hv-cinder-85535 Sep 25 04:45:06.972562 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-60e7fe0d-c0e3-4852-809c-c9de210e9a78 req-3df2e9a9-8308-46c1-855d-ce6fa46b2fd2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041080 Sep 25 04:45:06.973633 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 513/962] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:45:07.029975 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-4e0b8d66-c1ea-4643-a8af-0e337470a63c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:07.039347 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-4e0b8d66-c1ea-4643-a8af-0e337470a63c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d" status: 200 len: 1367 microversion: 2.1 time: 0.179886 Sep 25 04:45:07.039932 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 450/963] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:45:06 2022] GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:45:08.063553 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-b2b21041-154c-4791-8f73-032b62f25f03 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:08.064237 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-b2b21041-154c-4791-8f73-032b62f25f03 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 180dceb1-3b97-4345-b83b-6af39eea407d] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:08.066201 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell0:SELECT=6 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:45:08.073090 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b2b21041-154c-4791-8f73-032b62f25f03 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:08.073730 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b2b21041-154c-4791-8f73-032b62f25f03 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:08.074244 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b2b21041-154c-4791-8f73-032b62f25f03 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:08.074987 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b2b21041-154c-4791-8f73-032b62f25f03 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:08.075449 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b2b21041-154c-4791-8f73-032b62f25f03 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:08.076005 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b2b21041-154c-4791-8f73-032b62f25f03 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:08.208656 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-b2b21041-154c-4791-8f73-032b62f25f03 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:08.217221 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-b2b21041-154c-4791-8f73-032b62f25f03 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d" status: 200 len: 1367 microversion: 2.1 time: 0.157836 Sep 25 04:45:08.217785 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 514/964] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:45:08 2022] GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:45:09.241717 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-a92e43fe-f818-4bd3-b70a-94a268f60e43 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:09.242407 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-a92e43fe-f818-4bd3-b70a-94a268f60e43 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 180dceb1-3b97-4345-b83b-6af39eea407d] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:09.244197 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell0:SELECT=2 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:45:09.244896 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell0:SELECT=6 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:45:09.251177 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a92e43fe-f818-4bd3-b70a-94a268f60e43 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:09.251672 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a92e43fe-f818-4bd3-b70a-94a268f60e43 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:09.252110 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a92e43fe-f818-4bd3-b70a-94a268f60e43 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:09.252833 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a92e43fe-f818-4bd3-b70a-94a268f60e43 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:09.253304 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a92e43fe-f818-4bd3-b70a-94a268f60e43 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:09.253732 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a92e43fe-f818-4bd3-b70a-94a268f60e43 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:09.391449 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-a92e43fe-f818-4bd3-b70a-94a268f60e43 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:09.399229 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-a92e43fe-f818-4bd3-b70a-94a268f60e43 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d" status: 200 len: 1367 microversion: 2.1 time: 0.161876 Sep 25 04:45:09.399779 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 451/965] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:45:09 2022] GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:45:10.423365 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-2ae52a5a-5464-419a-86c2-08f7ed0d4693 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:10.424069 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-2ae52a5a-5464-419a-86c2-08f7ed0d4693 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 180dceb1-3b97-4345-b83b-6af39eea407d] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:10.431857 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2ae52a5a-5464-419a-86c2-08f7ed0d4693 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:10.432349 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2ae52a5a-5464-419a-86c2-08f7ed0d4693 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:10.432823 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2ae52a5a-5464-419a-86c2-08f7ed0d4693 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:10.433525 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2ae52a5a-5464-419a-86c2-08f7ed0d4693 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:10.433975 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2ae52a5a-5464-419a-86c2-08f7ed0d4693 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:10.434402 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2ae52a5a-5464-419a-86c2-08f7ed0d4693 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:10.567430 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-2ae52a5a-5464-419a-86c2-08f7ed0d4693 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:10.575993 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-2ae52a5a-5464-419a-86c2-08f7ed0d4693 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d" status: 200 len: 1558 microversion: 2.1 time: 0.156510 Sep 25 04:45:10.576567 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 515/966] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:45:10 2022] GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:45:10.599403 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-0628606e-ee54-4662-a644-159ff8599a3c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:10.599947 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-0628606e-ee54-4662-a644-159ff8599a3c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 180dceb1-3b97-4345-b83b-6af39eea407d] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:10.606035 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0628606e-ee54-4662-a644-159ff8599a3c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:10.606521 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0628606e-ee54-4662-a644-159ff8599a3c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:10.606959 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0628606e-ee54-4662-a644-159ff8599a3c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:10.607659 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0628606e-ee54-4662-a644-159ff8599a3c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:10.608119 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0628606e-ee54-4662-a644-159ff8599a3c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:10.608544 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0628606e-ee54-4662-a644-159ff8599a3c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:10.691570 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-0628606e-ee54-4662-a644-159ff8599a3c tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096603 Sep 25 04:45:10.692169 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 452/967] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Sep 25 04:45:10 2022] GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 04:45:11.663534 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-169b048b-7672-496a-8cac-2ebded5d4729 req-53722687-f779-4003-aeaf-212cba7999f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "180dceb1-3b97-4345-b83b-6af39eea407d", "tag": "18e015bb-0b7a-4eba-89bb-5e64e021a546"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:45:11.673904 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-169b048b-7672-496a-8cac-2ebded5d4729 req-53722687-f779-4003-aeaf-212cba7999f4 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:11.674388 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-169b048b-7672-496a-8cac-2ebded5d4729 req-53722687-f779-4003-aeaf-212cba7999f4 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:11.674855 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-169b048b-7672-496a-8cac-2ebded5d4729 req-53722687-f779-4003-aeaf-212cba7999f4 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:11.686458 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-169b048b-7672-496a-8cac-2ebded5d4729 req-53722687-f779-4003-aeaf-212cba7999f4 service nova] Creating event network-changed:18e015bb-0b7a-4eba-89bb-5e64e021a546 for instance 180dceb1-3b97-4345-b83b-6af39eea407d on hv-cinder-85535 Sep 25 04:45:11.691715 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-169b048b-7672-496a-8cac-2ebded5d4729 req-53722687-f779-4003-aeaf-212cba7999f4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032341 Sep 25 04:45:11.692781 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 516/968] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:45:12.727780 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-8fe35420-5edc-473d-a852-57cf8584eeb4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:12.729521 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-8fe35420-5edc-473d-a852-57cf8584eeb4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:12.737975 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8fe35420-5edc-473d-a852-57cf8584eeb4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:12.738464 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8fe35420-5edc-473d-a852-57cf8584eeb4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:12.738900 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8fe35420-5edc-473d-a852-57cf8584eeb4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:12.739599 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8fe35420-5edc-473d-a852-57cf8584eeb4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:12.740472 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8fe35420-5edc-473d-a852-57cf8584eeb4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:12.741191 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8fe35420-5edc-473d-a852-57cf8584eeb4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:12.774504 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-8fe35420-5edc-473d-a852-57cf8584eeb4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082/ips" status: 200 len: 152 microversion: 2.20 time: 0.051134 Sep 25 04:45:12.775676 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 453/969] 10.222.0.25 () {60 vars in 1289 bytes} [Sun Sep 25 04:45:12 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082/ips => generated 152 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 25 04:45:14.709349 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-10a5d92a-e1d3-4a5c-8737-d3224e005cb1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:45:14.709976 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-10a5d92a-e1d3-4a5c-8737-d3224e005cb1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:14.717069 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-10a5d92a-e1d3-4a5c-8737-d3224e005cb1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:14.717540 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-10a5d92a-e1d3-4a5c-8737-d3224e005cb1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:14.717983 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-10a5d92a-e1d3-4a5c-8737-d3224e005cb1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:14.718679 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-10a5d92a-e1d3-4a5c-8737-d3224e005cb1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:14.719141 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-10a5d92a-e1d3-4a5c-8737-d3224e005cb1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:14.719589 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-10a5d92a-e1d3-4a5c-8737-d3224e005cb1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:14.746480 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.objects.instance [None req-10a5d92a-e1d3-4a5c-8737-d3224e005cb1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lazy-loading 'flavor' on Instance uuid 8ae04d96-b4dc-4acf-9f79-4f6644c1a082 {{(pid=127142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 04:45:14.936804 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-10a5d92a-e1d3-4a5c-8737-d3224e005cb1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "POST /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082/action" status: 202 len: 0 microversion: 2.20 time: 0.231596 Sep 25 04:45:14.937393 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 517/970] 10.222.0.25 () {62 vars in 1319 bytes} [Sun Sep 25 04:45:14 2022] POST /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 25 04:45:14.945791 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-617aa680-a4c2-492b-92a0-bf9311f300d3 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:14.946524 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-617aa680-a4c2-492b-92a0-bf9311f300d3 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:14.953319 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-617aa680-a4c2-492b-92a0-bf9311f300d3 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:14.953817 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-617aa680-a4c2-492b-92a0-bf9311f300d3 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:14.954309 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-617aa680-a4c2-492b-92a0-bf9311f300d3 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:14.955123 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-617aa680-a4c2-492b-92a0-bf9311f300d3 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:14.955557 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-617aa680-a4c2-492b-92a0-bf9311f300d3 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:14.956056 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-617aa680-a4c2-492b-92a0-bf9311f300d3 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:15.092556 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-617aa680-a4c2-492b-92a0-bf9311f300d3 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:15.102164 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-617aa680-a4c2-492b-92a0-bf9311f300d3 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:15.103736 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-617aa680-a4c2-492b-92a0-bf9311f300d3 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:15.104941 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-617aa680-a4c2-492b-92a0-bf9311f300d3 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1724 microversion: 2.20 time: 0.163178 Sep 25 04:45:15.105497 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 454/971] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:45:14 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:45:16.131571 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-8f9bf487-b6ca-47a6-963d-5db8300a955c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:16.132180 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-8f9bf487-b6ca-47a6-963d-5db8300a955c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:16.139418 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8f9bf487-b6ca-47a6-963d-5db8300a955c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:16.139901 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8f9bf487-b6ca-47a6-963d-5db8300a955c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:16.140338 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8f9bf487-b6ca-47a6-963d-5db8300a955c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:16.141057 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8f9bf487-b6ca-47a6-963d-5db8300a955c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:16.141514 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8f9bf487-b6ca-47a6-963d-5db8300a955c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:16.141936 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8f9bf487-b6ca-47a6-963d-5db8300a955c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:16.275869 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-8f9bf487-b6ca-47a6-963d-5db8300a955c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:16.286878 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-8f9bf487-b6ca-47a6-963d-5db8300a955c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:16.288362 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-8f9bf487-b6ca-47a6-963d-5db8300a955c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:16.289786 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-8f9bf487-b6ca-47a6-963d-5db8300a955c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1724 microversion: 2.20 time: 0.163059 Sep 25 04:45:16.290349 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 518/972] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:45:16 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:45:17.315020 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-eb859d04-d312-4945-a363-047db323ce96 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:17.315609 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-eb859d04-d312-4945-a363-047db323ce96 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:17.322519 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-eb859d04-d312-4945-a363-047db323ce96 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:17.322996 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-eb859d04-d312-4945-a363-047db323ce96 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:17.323430 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-eb859d04-d312-4945-a363-047db323ce96 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:17.324109 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-eb859d04-d312-4945-a363-047db323ce96 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:17.324558 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-eb859d04-d312-4945-a363-047db323ce96 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:17.325002 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-eb859d04-d312-4945-a363-047db323ce96 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:17.327499 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=82 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:45:17.457866 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-eb859d04-d312-4945-a363-047db323ce96 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:17.467670 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-eb859d04-d312-4945-a363-047db323ce96 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:17.469149 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-eb859d04-d312-4945-a363-047db323ce96 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:17.470338 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-eb859d04-d312-4945-a363-047db323ce96 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1724 microversion: 2.20 time: 0.159281 Sep 25 04:45:17.470894 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 455/973] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:45:17 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:45:18.496622 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-11b5c6c5-87ca-4fb7-8db4-4177bb6f99be tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:18.497261 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-11b5c6c5-87ca-4fb7-8db4-4177bb6f99be tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:18.503878 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-11b5c6c5-87ca-4fb7-8db4-4177bb6f99be tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:18.504357 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-11b5c6c5-87ca-4fb7-8db4-4177bb6f99be tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:18.504819 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-11b5c6c5-87ca-4fb7-8db4-4177bb6f99be tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:18.505501 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-11b5c6c5-87ca-4fb7-8db4-4177bb6f99be tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:18.505949 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-11b5c6c5-87ca-4fb7-8db4-4177bb6f99be tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:18.506364 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-11b5c6c5-87ca-4fb7-8db4-4177bb6f99be tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:18.636907 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-11b5c6c5-87ca-4fb7-8db4-4177bb6f99be tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:18.644960 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-11b5c6c5-87ca-4fb7-8db4-4177bb6f99be tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:18.646403 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-11b5c6c5-87ca-4fb7-8db4-4177bb6f99be tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:18.647547 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-11b5c6c5-87ca-4fb7-8db4-4177bb6f99be tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1724 microversion: 2.20 time: 0.156047 Sep 25 04:45:18.648101 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 519/974] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:45:18 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:45:19.674079 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-2082fc50-253c-4c01-b3f4-9c4f25e93619 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:19.674691 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-2082fc50-253c-4c01-b3f4-9c4f25e93619 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:19.681307 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2082fc50-253c-4c01-b3f4-9c4f25e93619 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:19.681903 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2082fc50-253c-4c01-b3f4-9c4f25e93619 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:19.682346 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2082fc50-253c-4c01-b3f4-9c4f25e93619 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:19.683038 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2082fc50-253c-4c01-b3f4-9c4f25e93619 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:19.683497 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2082fc50-253c-4c01-b3f4-9c4f25e93619 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:19.683947 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2082fc50-253c-4c01-b3f4-9c4f25e93619 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:19.812881 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-2082fc50-253c-4c01-b3f4-9c4f25e93619 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:19.820932 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-2082fc50-253c-4c01-b3f4-9c4f25e93619 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:19.822462 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-2082fc50-253c-4c01-b3f4-9c4f25e93619 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:19.823627 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-2082fc50-253c-4c01-b3f4-9c4f25e93619 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1724 microversion: 2.20 time: 0.153634 Sep 25 04:45:19.824187 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 456/975] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:45:19 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:45:20.849028 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-805ef319-6412-412f-942c-c9187fe907ea tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:20.849572 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-805ef319-6412-412f-942c-c9187fe907ea tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:20.856447 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-805ef319-6412-412f-942c-c9187fe907ea tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:20.856972 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-805ef319-6412-412f-942c-c9187fe907ea tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:20.857412 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-805ef319-6412-412f-942c-c9187fe907ea tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:20.858105 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-805ef319-6412-412f-942c-c9187fe907ea tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:20.858560 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-805ef319-6412-412f-942c-c9187fe907ea tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:20.858990 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-805ef319-6412-412f-942c-c9187fe907ea tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:20.861701 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:45:20.996470 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-805ef319-6412-412f-942c-c9187fe907ea tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:21.004623 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-805ef319-6412-412f-942c-c9187fe907ea tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:21.006099 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-805ef319-6412-412f-942c-c9187fe907ea tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:21.007255 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-805ef319-6412-412f-942c-c9187fe907ea tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1724 microversion: 2.20 time: 0.162295 Sep 25 04:45:21.007811 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 520/976] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:45:20 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:45:22.033356 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-b2cd7d6f-1153-44e2-ab26-de9b13b0d99a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:22.033892 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-b2cd7d6f-1153-44e2-ab26-de9b13b0d99a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:22.040366 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b2cd7d6f-1153-44e2-ab26-de9b13b0d99a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:22.040916 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b2cd7d6f-1153-44e2-ab26-de9b13b0d99a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:22.041354 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b2cd7d6f-1153-44e2-ab26-de9b13b0d99a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:22.042039 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b2cd7d6f-1153-44e2-ab26-de9b13b0d99a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:22.042494 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b2cd7d6f-1153-44e2-ab26-de9b13b0d99a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:22.042922 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b2cd7d6f-1153-44e2-ab26-de9b13b0d99a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:22.171988 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-b2cd7d6f-1153-44e2-ab26-de9b13b0d99a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:22.179966 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-b2cd7d6f-1153-44e2-ab26-de9b13b0d99a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:22.181757 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-b2cd7d6f-1153-44e2-ab26-de9b13b0d99a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:22.182901 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-b2cd7d6f-1153-44e2-ab26-de9b13b0d99a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1724 microversion: 2.20 time: 0.153570 Sep 25 04:45:22.183461 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 457/977] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:45:22 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:45:23.208513 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-3fde7de6-5d6e-45dc-8f41-8d33154b83f0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:23.209322 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-3fde7de6-5d6e-45dc-8f41-8d33154b83f0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:23.216631 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3fde7de6-5d6e-45dc-8f41-8d33154b83f0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:23.217140 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3fde7de6-5d6e-45dc-8f41-8d33154b83f0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:23.217577 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3fde7de6-5d6e-45dc-8f41-8d33154b83f0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:23.218262 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3fde7de6-5d6e-45dc-8f41-8d33154b83f0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:23.218716 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3fde7de6-5d6e-45dc-8f41-8d33154b83f0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:23.219258 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3fde7de6-5d6e-45dc-8f41-8d33154b83f0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:23.349193 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-3fde7de6-5d6e-45dc-8f41-8d33154b83f0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:23.358098 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-3fde7de6-5d6e-45dc-8f41-8d33154b83f0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:23.359534 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-3fde7de6-5d6e-45dc-8f41-8d33154b83f0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:23.360729 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-3fde7de6-5d6e-45dc-8f41-8d33154b83f0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1724 microversion: 2.20 time: 0.156120 Sep 25 04:45:23.361283 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 521/978] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:45:23 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:45:24.386448 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-b8b69d09-39e3-4b9f-82f2-fab1ec77a06a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:24.387012 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-b8b69d09-39e3-4b9f-82f2-fab1ec77a06a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:24.393408 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b8b69d09-39e3-4b9f-82f2-fab1ec77a06a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:24.393891 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b8b69d09-39e3-4b9f-82f2-fab1ec77a06a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:24.394322 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b8b69d09-39e3-4b9f-82f2-fab1ec77a06a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:24.395007 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b8b69d09-39e3-4b9f-82f2-fab1ec77a06a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:24.395458 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b8b69d09-39e3-4b9f-82f2-fab1ec77a06a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:24.395879 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b8b69d09-39e3-4b9f-82f2-fab1ec77a06a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:24.523999 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-b8b69d09-39e3-4b9f-82f2-fab1ec77a06a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:24.532379 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-b8b69d09-39e3-4b9f-82f2-fab1ec77a06a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:24.533913 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-b8b69d09-39e3-4b9f-82f2-fab1ec77a06a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:24.535084 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-b8b69d09-39e3-4b9f-82f2-fab1ec77a06a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1724 microversion: 2.20 time: 0.153018 Sep 25 04:45:24.535638 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 458/979] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:45:24 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:45:25.561320 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-a8026bdd-f6ff-4d67-a145-cb2ca6feed90 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:25.561930 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-a8026bdd-f6ff-4d67-a145-cb2ca6feed90 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:25.568533 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a8026bdd-f6ff-4d67-a145-cb2ca6feed90 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:25.569058 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a8026bdd-f6ff-4d67-a145-cb2ca6feed90 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:25.569495 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a8026bdd-f6ff-4d67-a145-cb2ca6feed90 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:25.570182 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a8026bdd-f6ff-4d67-a145-cb2ca6feed90 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:25.570639 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a8026bdd-f6ff-4d67-a145-cb2ca6feed90 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:25.571666 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a8026bdd-f6ff-4d67-a145-cb2ca6feed90 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:25.696840 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-a8026bdd-f6ff-4d67-a145-cb2ca6feed90 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:25.705057 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-a8026bdd-f6ff-4d67-a145-cb2ca6feed90 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:25.706517 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-a8026bdd-f6ff-4d67-a145-cb2ca6feed90 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:25.707715 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-a8026bdd-f6ff-4d67-a145-cb2ca6feed90 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1724 microversion: 2.20 time: 0.150383 Sep 25 04:45:25.708269 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 522/980] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:45:25 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:45:26.734589 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-484ada06-2fab-4614-8f70-f695fc12ffbb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:26.735206 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-484ada06-2fab-4614-8f70-f695fc12ffbb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:26.737460 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:45:26.742449 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-484ada06-2fab-4614-8f70-f695fc12ffbb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:26.743436 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-484ada06-2fab-4614-8f70-f695fc12ffbb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:26.743882 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-484ada06-2fab-4614-8f70-f695fc12ffbb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:26.744606 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-484ada06-2fab-4614-8f70-f695fc12ffbb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:26.745091 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-484ada06-2fab-4614-8f70-f695fc12ffbb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:26.745524 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-484ada06-2fab-4614-8f70-f695fc12ffbb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:26.875728 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-484ada06-2fab-4614-8f70-f695fc12ffbb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:26.885286 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-484ada06-2fab-4614-8f70-f695fc12ffbb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:26.886766 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-484ada06-2fab-4614-8f70-f695fc12ffbb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:26.887914 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-484ada06-2fab-4614-8f70-f695fc12ffbb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1724 microversion: 2.20 time: 0.157372 Sep 25 04:45:26.888460 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 459/981] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:45:26 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:45:27.913329 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-f36db047-8888-4a02-893c-210ee4bbe1d5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:27.913939 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-f36db047-8888-4a02-893c-210ee4bbe1d5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:27.916101 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_api:SELECT=32 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:45:27.921566 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f36db047-8888-4a02-893c-210ee4bbe1d5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:27.922050 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f36db047-8888-4a02-893c-210ee4bbe1d5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:27.922476 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f36db047-8888-4a02-893c-210ee4bbe1d5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:27.923158 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f36db047-8888-4a02-893c-210ee4bbe1d5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:27.923609 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f36db047-8888-4a02-893c-210ee4bbe1d5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:27.924030 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f36db047-8888-4a02-893c-210ee4bbe1d5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:28.052927 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-f36db047-8888-4a02-893c-210ee4bbe1d5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:28.061685 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-f36db047-8888-4a02-893c-210ee4bbe1d5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:28.063116 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-f36db047-8888-4a02-893c-210ee4bbe1d5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:28.064264 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-f36db047-8888-4a02-893c-210ee4bbe1d5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1724 microversion: 2.20 time: 0.154914 Sep 25 04:45:28.064839 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 523/982] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:45:27 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:45:29.091181 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-64d4d02b-da17-4359-811e-81a2d831b3b4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:29.091796 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-64d4d02b-da17-4359-811e-81a2d831b3b4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:29.098291 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-64d4d02b-da17-4359-811e-81a2d831b3b4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:29.098778 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-64d4d02b-da17-4359-811e-81a2d831b3b4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:29.099214 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-64d4d02b-da17-4359-811e-81a2d831b3b4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:29.099905 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-64d4d02b-da17-4359-811e-81a2d831b3b4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:29.100364 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-64d4d02b-da17-4359-811e-81a2d831b3b4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:29.100833 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-64d4d02b-da17-4359-811e-81a2d831b3b4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:29.233376 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-64d4d02b-da17-4359-811e-81a2d831b3b4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:29.241284 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-64d4d02b-da17-4359-811e-81a2d831b3b4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:29.242712 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-64d4d02b-da17-4359-811e-81a2d831b3b4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:29.244158 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-64d4d02b-da17-4359-811e-81a2d831b3b4 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1724 microversion: 2.20 time: 0.157862 Sep 25 04:45:29.244928 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 460/983] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:45:29 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:45:30.270660 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-319e29e4-efdf-4174-b332-796178b79d75 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:30.271330 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-319e29e4-efdf-4174-b332-796178b79d75 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:30.278630 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-319e29e4-efdf-4174-b332-796178b79d75 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:30.279113 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-319e29e4-efdf-4174-b332-796178b79d75 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:30.279557 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-319e29e4-efdf-4174-b332-796178b79d75 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:30.280242 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-319e29e4-efdf-4174-b332-796178b79d75 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:30.280724 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-319e29e4-efdf-4174-b332-796178b79d75 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:30.281148 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-319e29e4-efdf-4174-b332-796178b79d75 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:30.416901 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-319e29e4-efdf-4174-b332-796178b79d75 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:30.425279 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-319e29e4-efdf-4174-b332-796178b79d75 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:30.426545 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-319e29e4-efdf-4174-b332-796178b79d75 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:30.427717 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-319e29e4-efdf-4174-b332-796178b79d75 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1724 microversion: 2.20 time: 0.160996 Sep 25 04:45:30.428260 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 524/984] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:45:30 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:45:31.453404 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-c292fe32-2926-4e42-8edb-f89aa4e28c90 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:31.454037 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-c292fe32-2926-4e42-8edb-f89aa4e28c90 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:31.460434 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c292fe32-2926-4e42-8edb-f89aa4e28c90 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:31.460945 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c292fe32-2926-4e42-8edb-f89aa4e28c90 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:31.461383 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c292fe32-2926-4e42-8edb-f89aa4e28c90 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:31.462482 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c292fe32-2926-4e42-8edb-f89aa4e28c90 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:31.462980 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c292fe32-2926-4e42-8edb-f89aa4e28c90 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:31.463409 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c292fe32-2926-4e42-8edb-f89aa4e28c90 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:31.602003 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-c292fe32-2926-4e42-8edb-f89aa4e28c90 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:31.611278 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-c292fe32-2926-4e42-8edb-f89aa4e28c90 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:31.613070 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-c292fe32-2926-4e42-8edb-f89aa4e28c90 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:31.614237 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-c292fe32-2926-4e42-8edb-f89aa4e28c90 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1724 microversion: 2.20 time: 0.164733 Sep 25 04:45:31.614780 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 461/985] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:45:31 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:45:32.640137 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-e2bc3a8a-01d2-4157-92f7-b3e40c598cba tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:32.640773 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-e2bc3a8a-01d2-4157-92f7-b3e40c598cba tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:32.647203 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e2bc3a8a-01d2-4157-92f7-b3e40c598cba tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:32.647677 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e2bc3a8a-01d2-4157-92f7-b3e40c598cba tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:32.648105 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e2bc3a8a-01d2-4157-92f7-b3e40c598cba tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:32.648817 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e2bc3a8a-01d2-4157-92f7-b3e40c598cba tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:32.649431 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e2bc3a8a-01d2-4157-92f7-b3e40c598cba tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:32.650008 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e2bc3a8a-01d2-4157-92f7-b3e40c598cba tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:32.780072 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-e2bc3a8a-01d2-4157-92f7-b3e40c598cba tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:32.789196 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-e2bc3a8a-01d2-4157-92f7-b3e40c598cba tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:32.790648 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-e2bc3a8a-01d2-4157-92f7-b3e40c598cba tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:32.791810 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-e2bc3a8a-01d2-4157-92f7-b3e40c598cba tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1745 microversion: 2.20 time: 0.155550 Sep 25 04:45:32.792360 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 525/986] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:45:32 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:45:33.818259 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-c9f37c2f-0496-4062-a8f6-d051e95c0157 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:33.818791 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-c9f37c2f-0496-4062-a8f6-d051e95c0157 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:33.825330 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c9f37c2f-0496-4062-a8f6-d051e95c0157 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:33.825815 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c9f37c2f-0496-4062-a8f6-d051e95c0157 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:33.826250 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c9f37c2f-0496-4062-a8f6-d051e95c0157 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:33.826969 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c9f37c2f-0496-4062-a8f6-d051e95c0157 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:33.827424 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c9f37c2f-0496-4062-a8f6-d051e95c0157 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:33.827853 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c9f37c2f-0496-4062-a8f6-d051e95c0157 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:33.955326 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-c9f37c2f-0496-4062-a8f6-d051e95c0157 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:33.963770 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-c9f37c2f-0496-4062-a8f6-d051e95c0157 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:33.965605 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-c9f37c2f-0496-4062-a8f6-d051e95c0157 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:33.966774 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-c9f37c2f-0496-4062-a8f6-d051e95c0157 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1745 microversion: 2.20 time: 0.152567 Sep 25 04:45:33.967330 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 462/987] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:45:33 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:45:34.479904 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-d270c293-ef11-4be0-9db2-c52596cef416 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:34.480500 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-d270c293-ef11-4be0-9db2-c52596cef416 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: ffac6eac-431f-426a-9819-d3a16eebbd6e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:34.486924 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d270c293-ef11-4be0-9db2-c52596cef416 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:34.487409 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d270c293-ef11-4be0-9db2-c52596cef416 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:34.487846 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d270c293-ef11-4be0-9db2-c52596cef416 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:34.488535 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d270c293-ef11-4be0-9db2-c52596cef416 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:34.489018 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d270c293-ef11-4be0-9db2-c52596cef416 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:34.489450 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d270c293-ef11-4be0-9db2-c52596cef416 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:34.512681 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-d270c293-ef11-4be0-9db2-c52596cef416 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e/ips" status: 200 len: 146 microversion: 2.1 time: 0.036970 Sep 25 04:45:34.513242 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 526/988] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Sep 25 04:45:34 2022] GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:45:34.992124 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-59ef4b4f-ec7f-43b9-9f63-469d3a4047df tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:34.993225 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-59ef4b4f-ec7f-43b9-9f63-469d3a4047df tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:34.999803 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-59ef4b4f-ec7f-43b9-9f63-469d3a4047df tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:35.000294 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-59ef4b4f-ec7f-43b9-9f63-469d3a4047df tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:35.000768 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-59ef4b4f-ec7f-43b9-9f63-469d3a4047df tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:35.001462 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-59ef4b4f-ec7f-43b9-9f63-469d3a4047df tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:35.001914 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-59ef4b4f-ec7f-43b9-9f63-469d3a4047df tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:35.002343 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-59ef4b4f-ec7f-43b9-9f63-469d3a4047df tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:35.137956 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-59ef4b4f-ec7f-43b9-9f63-469d3a4047df tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:35.147956 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-59ef4b4f-ec7f-43b9-9f63-469d3a4047df tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:35.149744 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-59ef4b4f-ec7f-43b9-9f63-469d3a4047df tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:35.151326 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-59ef4b4f-ec7f-43b9-9f63-469d3a4047df tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1745 microversion: 2.20 time: 0.163177 Sep 25 04:45:35.160370 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 463/989] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:45:34 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:45:36.178446 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-2f9c5999-b299-4ea4-b506-71e1a026c03c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:36.179048 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-2f9c5999-b299-4ea4-b506-71e1a026c03c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:36.185721 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2f9c5999-b299-4ea4-b506-71e1a026c03c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:36.186199 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2f9c5999-b299-4ea4-b506-71e1a026c03c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:36.186632 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2f9c5999-b299-4ea4-b506-71e1a026c03c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:36.187336 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2f9c5999-b299-4ea4-b506-71e1a026c03c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:36.187786 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2f9c5999-b299-4ea4-b506-71e1a026c03c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:36.188204 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2f9c5999-b299-4ea4-b506-71e1a026c03c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:36.316018 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-2f9c5999-b299-4ea4-b506-71e1a026c03c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:36.324625 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-2f9c5999-b299-4ea4-b506-71e1a026c03c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:36.326099 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-2f9c5999-b299-4ea4-b506-71e1a026c03c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:36.327246 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-2f9c5999-b299-4ea4-b506-71e1a026c03c tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1745 microversion: 2.20 time: 0.152707 Sep 25 04:45:36.327800 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 527/990] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:45:36 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:45:36.902522 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-b2a0ce9b-3512-40cc-9f6c-0b51b4b1b50e tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af3c6701-db57-4e83-b9fb-53b06b04f96c"}} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:45:36.904960 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-b2a0ce9b-3512-40cc-9f6c-0b51b4b1b50e tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: ffac6eac-431f-426a-9819-d3a16eebbd6e] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:36.911391 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b2a0ce9b-3512-40cc-9f6c-0b51b4b1b50e tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:36.911869 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b2a0ce9b-3512-40cc-9f6c-0b51b4b1b50e tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:36.912300 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b2a0ce9b-3512-40cc-9f6c-0b51b4b1b50e tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:36.913010 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b2a0ce9b-3512-40cc-9f6c-0b51b4b1b50e tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:36.913467 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b2a0ce9b-3512-40cc-9f6c-0b51b4b1b50e tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:36.913889 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b2a0ce9b-3512-40cc-9f6c-0b51b4b1b50e tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:37.353038 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-80f11f41-d483-44a4-9a62-646ad27d1b2e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:37.353650 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-80f11f41-d483-44a4-9a62-646ad27d1b2e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:37.359947 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-80f11f41-d483-44a4-9a62-646ad27d1b2e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:37.360428 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-80f11f41-d483-44a4-9a62-646ad27d1b2e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:37.360896 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-80f11f41-d483-44a4-9a62-646ad27d1b2e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:37.361572 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-80f11f41-d483-44a4-9a62-646ad27d1b2e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:37.362021 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-80f11f41-d483-44a4-9a62-646ad27d1b2e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:37.362440 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-80f11f41-d483-44a4-9a62-646ad27d1b2e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:37.494068 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-80f11f41-d483-44a4-9a62-646ad27d1b2e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:37.502024 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-80f11f41-d483-44a4-9a62-646ad27d1b2e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:37.503462 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-80f11f41-d483-44a4-9a62-646ad27d1b2e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:37.504603 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-80f11f41-d483-44a4-9a62-646ad27d1b2e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1745 microversion: 2.20 time: 0.155711 Sep 25 04:45:37.505178 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 528/991] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:45:37 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 04:45:38.531037 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-83b99329-3783-4d2f-b459-24e1bf156e0b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:38.531654 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-83b99329-3783-4d2f-b459-24e1bf156e0b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:38.538133 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-83b99329-3783-4d2f-b459-24e1bf156e0b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:38.538619 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-83b99329-3783-4d2f-b459-24e1bf156e0b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:38.539065 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-83b99329-3783-4d2f-b459-24e1bf156e0b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:38.540371 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-83b99329-3783-4d2f-b459-24e1bf156e0b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:38.540941 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-83b99329-3783-4d2f-b459-24e1bf156e0b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:38.541376 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-83b99329-3783-4d2f-b459-24e1bf156e0b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:38.667398 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-83b99329-3783-4d2f-b459-24e1bf156e0b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:38.675289 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-83b99329-3783-4d2f-b459-24e1bf156e0b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:38.676745 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-83b99329-3783-4d2f-b459-24e1bf156e0b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:38.677895 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-83b99329-3783-4d2f-b459-24e1bf156e0b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1745 microversion: 2.20 time: 0.150781 Sep 25 04:45:38.678439 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 529/992] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:45:38 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 04:45:39.702677 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-be6b3a7e-0d13-4db3-bb5b-7e00b38dea65 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:39.703365 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-be6b3a7e-0d13-4db3-bb5b-7e00b38dea65 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:39.709884 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-be6b3a7e-0d13-4db3-bb5b-7e00b38dea65 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:39.710375 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-be6b3a7e-0d13-4db3-bb5b-7e00b38dea65 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:39.710822 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-be6b3a7e-0d13-4db3-bb5b-7e00b38dea65 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:39.712034 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-be6b3a7e-0d13-4db3-bb5b-7e00b38dea65 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:39.712496 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-be6b3a7e-0d13-4db3-bb5b-7e00b38dea65 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:39.712953 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-be6b3a7e-0d13-4db3-bb5b-7e00b38dea65 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:39.845879 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-be6b3a7e-0d13-4db3-bb5b-7e00b38dea65 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:39.854599 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-be6b3a7e-0d13-4db3-bb5b-7e00b38dea65 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:39.856085 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-be6b3a7e-0d13-4db3-bb5b-7e00b38dea65 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:39.857308 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-be6b3a7e-0d13-4db3-bb5b-7e00b38dea65 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1745 microversion: 2.20 time: 0.158607 Sep 25 04:45:39.857872 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 530/993] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:45:39 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 04:45:40.462048 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-3b7214c5-3cf4-4ed2-824a-69b639a96903 req-0e73124c-dde5-4353-8ebd-88fddf79f33b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ae04d96-b4dc-4acf-9f79-4f6644c1a082", "name": "network-vif-plugged", "status": "completed", "tag": "67e59d38-b12f-4f51-bb79-591d93062336"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:45:40.473190 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-3b7214c5-3cf4-4ed2-824a-69b639a96903 req-0e73124c-dde5-4353-8ebd-88fddf79f33b service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:40.479255 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-3b7214c5-3cf4-4ed2-824a-69b639a96903 req-0e73124c-dde5-4353-8ebd-88fddf79f33b service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:40.479255 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-3b7214c5-3cf4-4ed2-824a-69b639a96903 req-0e73124c-dde5-4353-8ebd-88fddf79f33b service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:40.488716 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-3b7214c5-3cf4-4ed2-824a-69b639a96903 req-0e73124c-dde5-4353-8ebd-88fddf79f33b service nova] Creating event network-vif-plugged:67e59d38-b12f-4f51-bb79-591d93062336 for instance 8ae04d96-b4dc-4acf-9f79-4f6644c1a082 on hv-cinder-85535 Sep 25 04:45:40.496875 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-3b7214c5-3cf4-4ed2-824a-69b639a96903 req-0e73124c-dde5-4353-8ebd-88fddf79f33b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039901 Sep 25 04:45:40.497475 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 531/994] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 04:45:40.884097 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-0d6730e4-f458-41e9-89a8-60ee4d2e56e9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:40.884976 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-0d6730e4-f458-41e9-89a8-60ee4d2e56e9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:40.891408 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0d6730e4-f458-41e9-89a8-60ee4d2e56e9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:40.891932 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0d6730e4-f458-41e9-89a8-60ee4d2e56e9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:40.892377 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0d6730e4-f458-41e9-89a8-60ee4d2e56e9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:40.893124 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0d6730e4-f458-41e9-89a8-60ee4d2e56e9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:40.893600 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0d6730e4-f458-41e9-89a8-60ee4d2e56e9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:40.894071 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0d6730e4-f458-41e9-89a8-60ee4d2e56e9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:41.031720 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-0d6730e4-f458-41e9-89a8-60ee4d2e56e9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:41.040197 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-0d6730e4-f458-41e9-89a8-60ee4d2e56e9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:41.041689 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-0d6730e4-f458-41e9-89a8-60ee4d2e56e9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:41.042855 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-0d6730e4-f458-41e9-89a8-60ee4d2e56e9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1745 microversion: 2.20 time: 0.164001 Sep 25 04:45:41.043408 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 532/995] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:45:40 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 04:45:42.069296 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-1b0dbbe4-daa4-4d10-af5d-a88f52d65323 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:42.069937 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-1b0dbbe4-daa4-4d10-af5d-a88f52d65323 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:42.077261 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1b0dbbe4-daa4-4d10-af5d-a88f52d65323 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:42.077744 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1b0dbbe4-daa4-4d10-af5d-a88f52d65323 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:42.078176 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1b0dbbe4-daa4-4d10-af5d-a88f52d65323 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:42.080008 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1b0dbbe4-daa4-4d10-af5d-a88f52d65323 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:42.080464 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1b0dbbe4-daa4-4d10-af5d-a88f52d65323 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:42.080816 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-b2a0ce9b-3512-40cc-9f6c-0b51b4b1b50e tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "POST /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.182809 Sep 25 04:45:42.081301 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1b0dbbe4-daa4-4d10-af5d-a88f52d65323 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:42.081783 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 464/996] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Sep 25 04:45:36 2022] POST /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e/os-volume_attachments => generated 194 bytes in 5184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:45:42.224333 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-1b0dbbe4-daa4-4d10-af5d-a88f52d65323 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:42.233413 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-1b0dbbe4-daa4-4d10-af5d-a88f52d65323 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:42.234852 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-1b0dbbe4-daa4-4d10-af5d-a88f52d65323 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:42.236101 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-1b0dbbe4-daa4-4d10-af5d-a88f52d65323 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1745 microversion: 2.20 time: 0.170955 Sep 25 04:45:42.236673 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 533/997] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:45:42 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 04:45:43.263265 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-34dfb265-55fd-49dc-b16a-19920b1a1412 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:43.263980 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-34dfb265-55fd-49dc-b16a-19920b1a1412 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:43.270137 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-34dfb265-55fd-49dc-b16a-19920b1a1412 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:43.270642 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-34dfb265-55fd-49dc-b16a-19920b1a1412 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:43.271066 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-34dfb265-55fd-49dc-b16a-19920b1a1412 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:43.271766 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-34dfb265-55fd-49dc-b16a-19920b1a1412 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:43.272221 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-34dfb265-55fd-49dc-b16a-19920b1a1412 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:43.272681 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-34dfb265-55fd-49dc-b16a-19920b1a1412 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:43.408044 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-34dfb265-55fd-49dc-b16a-19920b1a1412 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:43.416671 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-34dfb265-55fd-49dc-b16a-19920b1a1412 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:43.418128 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-34dfb265-55fd-49dc-b16a-19920b1a1412 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:43.419297 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-34dfb265-55fd-49dc-b16a-19920b1a1412 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1745 microversion: 2.20 time: 0.160905 Sep 25 04:45:43.419847 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 465/998] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:45:43 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:45:44.445047 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-b4f9dec2-f7c2-4d76-ac77-057538c5f7af tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:44.445683 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-b4f9dec2-f7c2-4d76-ac77-057538c5f7af tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:44.452340 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b4f9dec2-f7c2-4d76-ac77-057538c5f7af tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:44.452867 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b4f9dec2-f7c2-4d76-ac77-057538c5f7af tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:44.453299 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b4f9dec2-f7c2-4d76-ac77-057538c5f7af tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:44.453991 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b4f9dec2-f7c2-4d76-ac77-057538c5f7af tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:44.454560 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b4f9dec2-f7c2-4d76-ac77-057538c5f7af tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:44.454985 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b4f9dec2-f7c2-4d76-ac77-057538c5f7af tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:44.590936 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-b4f9dec2-f7c2-4d76-ac77-057538c5f7af tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:44.599037 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-b4f9dec2-f7c2-4d76-ac77-057538c5f7af tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:44.600529 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-b4f9dec2-f7c2-4d76-ac77-057538c5f7af tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:44.601726 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-b4f9dec2-f7c2-4d76-ac77-057538c5f7af tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1740 microversion: 2.20 time: 0.160825 Sep 25 04:45:44.602283 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 534/999] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:45:44 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1740 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:45:45.628002 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-29c8d0cb-4523-4822-99e2-daa008d3e54a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:45.629422 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-29c8d0cb-4523-4822-99e2-daa008d3e54a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:45.636683 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-29c8d0cb-4523-4822-99e2-daa008d3e54a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:45.637447 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-29c8d0cb-4523-4822-99e2-daa008d3e54a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:45.638101 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-29c8d0cb-4523-4822-99e2-daa008d3e54a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:45.638954 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-29c8d0cb-4523-4822-99e2-daa008d3e54a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:45.639426 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-29c8d0cb-4523-4822-99e2-daa008d3e54a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:45.639858 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-29c8d0cb-4523-4822-99e2-daa008d3e54a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:45.810407 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-29c8d0cb-4523-4822-99e2-daa008d3e54a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:45.820261 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-29c8d0cb-4523-4822-99e2-daa008d3e54a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:45.822048 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-29c8d0cb-4523-4822-99e2-daa008d3e54a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:45.823891 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-29c8d0cb-4523-4822-99e2-daa008d3e54a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1740 microversion: 2.20 time: 0.200243 Sep 25 04:45:45.837199 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 466/1000] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:45:45 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1740 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:45:46.855229 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-33cf18f3-23a5-4335-9abe-51e4431a3efd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:46.855844 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-33cf18f3-23a5-4335-9abe-51e4431a3efd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:46.868070 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-33cf18f3-23a5-4335-9abe-51e4431a3efd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:46.870750 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-33cf18f3-23a5-4335-9abe-51e4431a3efd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:46.871641 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-33cf18f3-23a5-4335-9abe-51e4431a3efd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:46.872519 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-33cf18f3-23a5-4335-9abe-51e4431a3efd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:46.873156 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-33cf18f3-23a5-4335-9abe-51e4431a3efd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:46.873762 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-33cf18f3-23a5-4335-9abe-51e4431a3efd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:47.025696 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-33cf18f3-23a5-4335-9abe-51e4431a3efd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:47.034205 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-33cf18f3-23a5-4335-9abe-51e4431a3efd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:47.035680 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-33cf18f3-23a5-4335-9abe-51e4431a3efd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:47.037110 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-33cf18f3-23a5-4335-9abe-51e4431a3efd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1740 microversion: 2.20 time: 0.189191 Sep 25 04:45:47.037971 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 535/1001] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:45:46 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:45:48.063913 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-71addc4d-8d57-454f-99bd-f6de7dff2ef1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:48.064438 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-71addc4d-8d57-454f-99bd-f6de7dff2ef1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:48.071189 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-71addc4d-8d57-454f-99bd-f6de7dff2ef1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:48.071977 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-71addc4d-8d57-454f-99bd-f6de7dff2ef1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:48.073230 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-71addc4d-8d57-454f-99bd-f6de7dff2ef1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:48.074210 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-71addc4d-8d57-454f-99bd-f6de7dff2ef1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:48.074743 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-71addc4d-8d57-454f-99bd-f6de7dff2ef1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:48.075188 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-71addc4d-8d57-454f-99bd-f6de7dff2ef1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:48.078120 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:45:48.218230 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-71addc4d-8d57-454f-99bd-f6de7dff2ef1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:48.226964 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-71addc4d-8d57-454f-99bd-f6de7dff2ef1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:48.228977 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-71addc4d-8d57-454f-99bd-f6de7dff2ef1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:48.230558 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-71addc4d-8d57-454f-99bd-f6de7dff2ef1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1740 microversion: 2.20 time: 0.170658 Sep 25 04:45:48.231117 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 467/1002] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:45:48 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:45:49.257672 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-9cb2d034-5d26-4bb2-94d2-2ddd4702d5c5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:49.259621 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-9cb2d034-5d26-4bb2-94d2-2ddd4702d5c5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:49.268026 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9cb2d034-5d26-4bb2-94d2-2ddd4702d5c5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:49.269120 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9cb2d034-5d26-4bb2-94d2-2ddd4702d5c5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:49.269790 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9cb2d034-5d26-4bb2-94d2-2ddd4702d5c5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:49.270902 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9cb2d034-5d26-4bb2-94d2-2ddd4702d5c5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:49.271556 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9cb2d034-5d26-4bb2-94d2-2ddd4702d5c5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:49.272483 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9cb2d034-5d26-4bb2-94d2-2ddd4702d5c5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:49.436323 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-9cb2d034-5d26-4bb2-94d2-2ddd4702d5c5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:49.446211 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-9cb2d034-5d26-4bb2-94d2-2ddd4702d5c5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:49.448897 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-9cb2d034-5d26-4bb2-94d2-2ddd4702d5c5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:49.450335 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-9cb2d034-5d26-4bb2-94d2-2ddd4702d5c5 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1740 microversion: 2.20 time: 0.196886 Sep 25 04:45:49.451409 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 536/1003] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:45:49 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1740 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:45:50.501449 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-8f0b2d5e-243e-4e69-ba7c-90e0f089cdd8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:50.501449 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-8f0b2d5e-243e-4e69-ba7c-90e0f089cdd8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:50.503748 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8f0b2d5e-243e-4e69-ba7c-90e0f089cdd8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:50.504859 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8f0b2d5e-243e-4e69-ba7c-90e0f089cdd8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:50.506494 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8f0b2d5e-243e-4e69-ba7c-90e0f089cdd8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:50.509179 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8f0b2d5e-243e-4e69-ba7c-90e0f089cdd8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:50.511218 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8f0b2d5e-243e-4e69-ba7c-90e0f089cdd8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:50.512164 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8f0b2d5e-243e-4e69-ba7c-90e0f089cdd8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:50.700281 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-8f0b2d5e-243e-4e69-ba7c-90e0f089cdd8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:50.725706 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-8f0b2d5e-243e-4e69-ba7c-90e0f089cdd8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:50.727276 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-8f0b2d5e-243e-4e69-ba7c-90e0f089cdd8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:50.728882 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-8f0b2d5e-243e-4e69-ba7c-90e0f089cdd8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1740 microversion: 2.20 time: 0.253735 Sep 25 04:45:50.729650 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 468/1004] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:45:50 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1740 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:45:51.754215 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-973129bf-a0f1-489b-9add-e575c84234a3 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:51.755496 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-973129bf-a0f1-489b-9add-e575c84234a3 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:51.764282 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-973129bf-a0f1-489b-9add-e575c84234a3 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:51.767616 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-973129bf-a0f1-489b-9add-e575c84234a3 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:51.768235 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-973129bf-a0f1-489b-9add-e575c84234a3 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:51.769550 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-973129bf-a0f1-489b-9add-e575c84234a3 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:51.770045 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-973129bf-a0f1-489b-9add-e575c84234a3 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:51.770495 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-973129bf-a0f1-489b-9add-e575c84234a3 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:51.777757 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=96 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:45:52.006363 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-973129bf-a0f1-489b-9add-e575c84234a3 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:52.016816 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-973129bf-a0f1-489b-9add-e575c84234a3 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:52.018531 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-973129bf-a0f1-489b-9add-e575c84234a3 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:52.019941 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-973129bf-a0f1-489b-9add-e575c84234a3 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1740 microversion: 2.20 time: 0.269799 Sep 25 04:45:52.020607 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 537/1005] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:45:51 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1740 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:45:53.053152 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-5608d981-414b-4808-bfa7-a115643eb367 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:53.053152 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-5608d981-414b-4808-bfa7-a115643eb367 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:53.062400 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5608d981-414b-4808-bfa7-a115643eb367 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:53.062400 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5608d981-414b-4808-bfa7-a115643eb367 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:53.062400 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5608d981-414b-4808-bfa7-a115643eb367 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:53.062400 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5608d981-414b-4808-bfa7-a115643eb367 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:53.062728 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5608d981-414b-4808-bfa7-a115643eb367 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:53.062882 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5608d981-414b-4808-bfa7-a115643eb367 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:53.206087 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-5608d981-414b-4808-bfa7-a115643eb367 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:53.216820 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-5608d981-414b-4808-bfa7-a115643eb367 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:53.218406 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-5608d981-414b-4808-bfa7-a115643eb367 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:53.219586 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-5608d981-414b-4808-bfa7-a115643eb367 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1740 microversion: 2.20 time: 0.171954 Sep 25 04:45:53.220132 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 469/1006] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:45:53 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:45:54.245583 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-dce03d68-d983-4ce9-b214-eb0bfd15caab tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:54.246197 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-dce03d68-d983-4ce9-b214-eb0bfd15caab tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:54.252604 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-dce03d68-d983-4ce9-b214-eb0bfd15caab tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:54.253189 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-dce03d68-d983-4ce9-b214-eb0bfd15caab tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:54.253627 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-dce03d68-d983-4ce9-b214-eb0bfd15caab tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:54.254312 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-dce03d68-d983-4ce9-b214-eb0bfd15caab tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:54.254773 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-dce03d68-d983-4ce9-b214-eb0bfd15caab tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:54.255197 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-dce03d68-d983-4ce9-b214-eb0bfd15caab tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:54.381802 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-dce03d68-d983-4ce9-b214-eb0bfd15caab tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:54.390347 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-dce03d68-d983-4ce9-b214-eb0bfd15caab tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:54.391794 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-dce03d68-d983-4ce9-b214-eb0bfd15caab tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:54.392984 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-dce03d68-d983-4ce9-b214-eb0bfd15caab tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1740 microversion: 2.20 time: 0.151500 Sep 25 04:45:54.393541 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 538/1007] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:45:54 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1740 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:45:55.419359 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-7911ba28-fb9d-4a07-ba60-3f4d309f3625 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:55.419966 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-7911ba28-fb9d-4a07-ba60-3f4d309f3625 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:55.426384 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7911ba28-fb9d-4a07-ba60-3f4d309f3625 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:55.426864 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7911ba28-fb9d-4a07-ba60-3f4d309f3625 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:55.427297 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7911ba28-fb9d-4a07-ba60-3f4d309f3625 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:55.427973 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7911ba28-fb9d-4a07-ba60-3f4d309f3625 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:55.428423 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7911ba28-fb9d-4a07-ba60-3f4d309f3625 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:55.428874 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7911ba28-fb9d-4a07-ba60-3f4d309f3625 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:55.559422 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-7911ba28-fb9d-4a07-ba60-3f4d309f3625 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:55.567423 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-7911ba28-fb9d-4a07-ba60-3f4d309f3625 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:55.568889 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-7911ba28-fb9d-4a07-ba60-3f4d309f3625 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:55.570036 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-7911ba28-fb9d-4a07-ba60-3f4d309f3625 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1740 microversion: 2.20 time: 0.154948 Sep 25 04:45:55.570588 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 470/1008] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:45:55 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1740 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:45:56.596711 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-45a5d88a-dd1f-4ac2-8632-e4e9c6be29ea tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:56.597321 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-45a5d88a-dd1f-4ac2-8632-e4e9c6be29ea tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:56.603629 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-45a5d88a-dd1f-4ac2-8632-e4e9c6be29ea tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:56.604117 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-45a5d88a-dd1f-4ac2-8632-e4e9c6be29ea tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:56.604554 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-45a5d88a-dd1f-4ac2-8632-e4e9c6be29ea tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:56.605374 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-45a5d88a-dd1f-4ac2-8632-e4e9c6be29ea tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:56.605823 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-45a5d88a-dd1f-4ac2-8632-e4e9c6be29ea tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:56.606250 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-45a5d88a-dd1f-4ac2-8632-e4e9c6be29ea tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:56.733468 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-45a5d88a-dd1f-4ac2-8632-e4e9c6be29ea tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:56.741366 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-45a5d88a-dd1f-4ac2-8632-e4e9c6be29ea tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:56.742808 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-45a5d88a-dd1f-4ac2-8632-e4e9c6be29ea tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:56.743957 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-45a5d88a-dd1f-4ac2-8632-e4e9c6be29ea tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1740 microversion: 2.20 time: 0.151213 Sep 25 04:45:56.744509 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 539/1009] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:45:56 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1740 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:45:57.769624 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-4db2f43c-5361-4d9f-a1c7-390bdbe51bf8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:57.770224 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-4db2f43c-5361-4d9f-a1c7-390bdbe51bf8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:57.772538 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_api:SELECT=24 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:45:57.777994 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4db2f43c-5361-4d9f-a1c7-390bdbe51bf8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:57.778473 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4db2f43c-5361-4d9f-a1c7-390bdbe51bf8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:57.778907 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4db2f43c-5361-4d9f-a1c7-390bdbe51bf8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:57.779591 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4db2f43c-5361-4d9f-a1c7-390bdbe51bf8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:57.780042 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4db2f43c-5361-4d9f-a1c7-390bdbe51bf8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:57.780465 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4db2f43c-5361-4d9f-a1c7-390bdbe51bf8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:58.087654 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-4db2f43c-5361-4d9f-a1c7-390bdbe51bf8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:58.096050 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-4db2f43c-5361-4d9f-a1c7-390bdbe51bf8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:58.097542 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-4db2f43c-5361-4d9f-a1c7-390bdbe51bf8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:58.098714 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-4db2f43c-5361-4d9f-a1c7-390bdbe51bf8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1740 microversion: 2.20 time: 0.333031 Sep 25 04:45:58.099276 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 471/1010] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:45:57 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1740 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:45:59.128262 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-bf9b9dab-a736-4370-8d4a-04cf55678b61 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:45:59.128898 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-bf9b9dab-a736-4370-8d4a-04cf55678b61 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:45:59.131258 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_api:SELECT=34 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:45:59.136877 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bf9b9dab-a736-4370-8d4a-04cf55678b61 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:59.137357 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bf9b9dab-a736-4370-8d4a-04cf55678b61 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:59.137787 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bf9b9dab-a736-4370-8d4a-04cf55678b61 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:59.138471 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bf9b9dab-a736-4370-8d4a-04cf55678b61 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:45:59.138918 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bf9b9dab-a736-4370-8d4a-04cf55678b61 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:45:59.139340 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-bf9b9dab-a736-4370-8d4a-04cf55678b61 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:45:59.317284 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-bf9b9dab-a736-4370-8d4a-04cf55678b61 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:59.325643 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-bf9b9dab-a736-4370-8d4a-04cf55678b61 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:59.327128 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-bf9b9dab-a736-4370-8d4a-04cf55678b61 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:45:59.328289 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-bf9b9dab-a736-4370-8d4a-04cf55678b61 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1740 microversion: 2.20 time: 0.203928 Sep 25 04:45:59.328901 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 540/1011] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:45:59 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1740 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:46:00.353740 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-344d99e3-d4cf-4b73-a2fe-d4ad17d69a62 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:00.354493 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-344d99e3-d4cf-4b73-a2fe-d4ad17d69a62 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:00.361190 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-344d99e3-d4cf-4b73-a2fe-d4ad17d69a62 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:00.361669 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-344d99e3-d4cf-4b73-a2fe-d4ad17d69a62 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:00.362105 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-344d99e3-d4cf-4b73-a2fe-d4ad17d69a62 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:00.362785 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-344d99e3-d4cf-4b73-a2fe-d4ad17d69a62 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:00.363238 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-344d99e3-d4cf-4b73-a2fe-d4ad17d69a62 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:00.363721 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-344d99e3-d4cf-4b73-a2fe-d4ad17d69a62 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:00.496812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-344d99e3-d4cf-4b73-a2fe-d4ad17d69a62 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:00.504935 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-344d99e3-d4cf-4b73-a2fe-d4ad17d69a62 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:00.506377 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-344d99e3-d4cf-4b73-a2fe-d4ad17d69a62 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:00.507533 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-344d99e3-d4cf-4b73-a2fe-d4ad17d69a62 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1740 microversion: 2.20 time: 0.157811 Sep 25 04:46:00.508085 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 472/1012] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:46:00 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:46:01.532820 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-38f2cea8-4ad7-44bd-bad2-36a8ac1f7d7f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:01.533459 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-38f2cea8-4ad7-44bd-bad2-36a8ac1f7d7f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:01.536305 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 25 04:46:01.536444 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Sun Sep 25 04:46:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 (ip 10.222.0.25) !!! Sep 25 04:46:01.543173 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-38f2cea8-4ad7-44bd-bad2-36a8ac1f7d7f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:01.543655 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-38f2cea8-4ad7-44bd-bad2-36a8ac1f7d7f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:01.544091 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-38f2cea8-4ad7-44bd-bad2-36a8ac1f7d7f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:01.544813 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-38f2cea8-4ad7-44bd-bad2-36a8ac1f7d7f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:01.545270 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-38f2cea8-4ad7-44bd-bad2-36a8ac1f7d7f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:01.545693 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-38f2cea8-4ad7-44bd-bad2-36a8ac1f7d7f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:01.674483 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-38f2cea8-4ad7-44bd-bad2-36a8ac1f7d7f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:01.683086 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-38f2cea8-4ad7-44bd-bad2-36a8ac1f7d7f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:01.684597 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-38f2cea8-4ad7-44bd-bad2-36a8ac1f7d7f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:01.685778 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-38f2cea8-4ad7-44bd-bad2-36a8ac1f7d7f tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1740 microversion: 2.20 time: 0.156828 Sep 25 04:46:01.686333 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 541/1013] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:46:01 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1740 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:46:02.712171 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-248f2260-f1d5-4b5b-9f27-845e1c8b3763 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:02.712858 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-248f2260-f1d5-4b5b-9f27-845e1c8b3763 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:02.719871 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-248f2260-f1d5-4b5b-9f27-845e1c8b3763 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:02.720360 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-248f2260-f1d5-4b5b-9f27-845e1c8b3763 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:02.720839 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-248f2260-f1d5-4b5b-9f27-845e1c8b3763 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:02.721536 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-248f2260-f1d5-4b5b-9f27-845e1c8b3763 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:02.721992 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-248f2260-f1d5-4b5b-9f27-845e1c8b3763 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:02.722420 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-248f2260-f1d5-4b5b-9f27-845e1c8b3763 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:02.847405 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-248f2260-f1d5-4b5b-9f27-845e1c8b3763 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:02.856534 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-248f2260-f1d5-4b5b-9f27-845e1c8b3763 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:02.858031 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-248f2260-f1d5-4b5b-9f27-845e1c8b3763 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:02.859194 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-248f2260-f1d5-4b5b-9f27-845e1c8b3763 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1740 microversion: 2.20 time: 0.150928 Sep 25 04:46:02.859757 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 473/1014] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:46:02 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1740 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:46:04.024560 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-c05aa468-fb4c-4305-936c-dbbfd20cedd8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:04.025236 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-c05aa468-fb4c-4305-936c-dbbfd20cedd8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:04.032804 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c05aa468-fb4c-4305-936c-dbbfd20cedd8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:04.033419 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c05aa468-fb4c-4305-936c-dbbfd20cedd8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:04.033860 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c05aa468-fb4c-4305-936c-dbbfd20cedd8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:04.034556 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c05aa468-fb4c-4305-936c-dbbfd20cedd8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:04.035059 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c05aa468-fb4c-4305-936c-dbbfd20cedd8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:04.035554 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c05aa468-fb4c-4305-936c-dbbfd20cedd8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:04.260987 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-c05aa468-fb4c-4305-936c-dbbfd20cedd8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:04.269206 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-c05aa468-fb4c-4305-936c-dbbfd20cedd8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:04.270633 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-c05aa468-fb4c-4305-936c-dbbfd20cedd8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:04.271778 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-c05aa468-fb4c-4305-936c-dbbfd20cedd8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1740 microversion: 2.20 time: 0.391345 Sep 25 04:46:04.272332 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 542/1015] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:46:03 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1740 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:46:04.630289 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-0742d933-2b54-45e2-82a2-69e9301c5d9e tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:04.632659 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-0742d933-2b54-45e2-82a2-69e9301c5d9e tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: ffac6eac-431f-426a-9819-d3a16eebbd6e] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:04.639282 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0742d933-2b54-45e2-82a2-69e9301c5d9e tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:04.639774 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0742d933-2b54-45e2-82a2-69e9301c5d9e tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:04.640217 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0742d933-2b54-45e2-82a2-69e9301c5d9e tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:04.640941 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0742d933-2b54-45e2-82a2-69e9301c5d9e tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:04.641407 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0742d933-2b54-45e2-82a2-69e9301c5d9e tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:04.641840 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0742d933-2b54-45e2-82a2-69e9301c5d9e tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:04.675410 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-0742d933-2b54-45e2-82a2-69e9301c5d9e tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049144 Sep 25 04:46:04.675970 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 474/1016] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 25 04:46:04 2022] GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:46:04.687355 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-704a11cd-18bb-4ea2-9a83-79383d59dd49 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:04.687879 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-704a11cd-18bb-4ea2-9a83-79383d59dd49 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: ffac6eac-431f-426a-9819-d3a16eebbd6e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:04.693942 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-704a11cd-18bb-4ea2-9a83-79383d59dd49 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:04.694418 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-704a11cd-18bb-4ea2-9a83-79383d59dd49 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:04.694904 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-704a11cd-18bb-4ea2-9a83-79383d59dd49 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:04.695592 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-704a11cd-18bb-4ea2-9a83-79383d59dd49 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:04.696042 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-704a11cd-18bb-4ea2-9a83-79383d59dd49 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:04.696463 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-704a11cd-18bb-4ea2-9a83-79383d59dd49 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:04.726996 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-704a11cd-18bb-4ea2-9a83-79383d59dd49 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e/os-volume_attachments/af3c6701-db57-4e83-b9fb-53b06b04f96c" status: 200 len: 194 microversion: 2.1 time: 0.043535 Sep 25 04:46:04.727585 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 543/1017] 10.222.0.25 () {58 vars in 1413 bytes} [Sun Sep 25 04:46:04 2022] GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e/os-volume_attachments/af3c6701-db57-4e83-b9fb-53b06b04f96c => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 04:46:05.297995 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-47a43a15-3533-4aaa-bc12-7ac379159bd0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:05.298738 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-47a43a15-3533-4aaa-bc12-7ac379159bd0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:05.305480 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-47a43a15-3533-4aaa-bc12-7ac379159bd0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:05.305720 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-47a43a15-3533-4aaa-bc12-7ac379159bd0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:05.306326 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-47a43a15-3533-4aaa-bc12-7ac379159bd0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:05.307047 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-47a43a15-3533-4aaa-bc12-7ac379159bd0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:05.308087 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-47a43a15-3533-4aaa-bc12-7ac379159bd0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:05.308919 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-47a43a15-3533-4aaa-bc12-7ac379159bd0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:05.504004 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-47a43a15-3533-4aaa-bc12-7ac379159bd0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:05.512952 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-47a43a15-3533-4aaa-bc12-7ac379159bd0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:05.514458 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-47a43a15-3533-4aaa-bc12-7ac379159bd0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:05.515638 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-47a43a15-3533-4aaa-bc12-7ac379159bd0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1722 microversion: 2.20 time: 0.222013 Sep 25 04:46:05.516189 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 475/1018] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:46:05 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:46:06.076743 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-e96f331a-f46b-42c3-bb5b-0893125078f5 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c63f4a20-dbfe-4984-bf88-367e2e2d2a4e"}} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:46:06.079261 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-e96f331a-f46b-42c3-bb5b-0893125078f5 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: ffac6eac-431f-426a-9819-d3a16eebbd6e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:06.085805 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e96f331a-f46b-42c3-bb5b-0893125078f5 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:06.086299 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e96f331a-f46b-42c3-bb5b-0893125078f5 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:06.086771 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e96f331a-f46b-42c3-bb5b-0893125078f5 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:06.087464 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e96f331a-f46b-42c3-bb5b-0893125078f5 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:06.087928 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e96f331a-f46b-42c3-bb5b-0893125078f5 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:06.088361 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e96f331a-f46b-42c3-bb5b-0893125078f5 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:06.540197 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-2c85740b-1f99-490e-bb3a-59bb6bac6656 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:06.540895 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-2c85740b-1f99-490e-bb3a-59bb6bac6656 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:06.548373 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2c85740b-1f99-490e-bb3a-59bb6bac6656 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:06.548922 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2c85740b-1f99-490e-bb3a-59bb6bac6656 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:06.549368 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2c85740b-1f99-490e-bb3a-59bb6bac6656 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:06.550088 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2c85740b-1f99-490e-bb3a-59bb6bac6656 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:06.550529 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2c85740b-1f99-490e-bb3a-59bb6bac6656 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:06.550954 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2c85740b-1f99-490e-bb3a-59bb6bac6656 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:06.683349 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-2c85740b-1f99-490e-bb3a-59bb6bac6656 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:06.692008 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-2c85740b-1f99-490e-bb3a-59bb6bac6656 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:06.693499 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-2c85740b-1f99-490e-bb3a-59bb6bac6656 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:06.694679 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-2c85740b-1f99-490e-bb3a-59bb6bac6656 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1722 microversion: 2.20 time: 0.158386 Sep 25 04:46:06.695233 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 476/1019] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:46:06 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:46:07.572459 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-e96f331a-f46b-42c3-bb5b-0893125078f5 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "POST /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.499627 Sep 25 04:46:07.573107 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 544/1020] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Sep 25 04:46:06 2022] POST /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e/os-volume_attachments => generated 194 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:46:07.720589 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-1c9cbc8b-7fa0-4a59-8e02-d77f1cdcda54 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:07.721281 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-1c9cbc8b-7fa0-4a59-8e02-d77f1cdcda54 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:07.728505 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1c9cbc8b-7fa0-4a59-8e02-d77f1cdcda54 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:07.729028 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1c9cbc8b-7fa0-4a59-8e02-d77f1cdcda54 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:07.729468 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1c9cbc8b-7fa0-4a59-8e02-d77f1cdcda54 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:07.730170 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1c9cbc8b-7fa0-4a59-8e02-d77f1cdcda54 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:07.730634 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1c9cbc8b-7fa0-4a59-8e02-d77f1cdcda54 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:07.731060 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1c9cbc8b-7fa0-4a59-8e02-d77f1cdcda54 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:07.875921 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-1c9cbc8b-7fa0-4a59-8e02-d77f1cdcda54 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:07.884582 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-1c9cbc8b-7fa0-4a59-8e02-d77f1cdcda54 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:07.886165 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-1c9cbc8b-7fa0-4a59-8e02-d77f1cdcda54 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:07.887888 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-1c9cbc8b-7fa0-4a59-8e02-d77f1cdcda54 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1722 microversion: 2.20 time: 0.172008 Sep 25 04:46:07.901286 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 477/1021] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:46:07 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:46:08.696906 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-01b518fc-7508-4526-80bb-af4c04879001 req-d5026ced-86cb-454a-9623-102cdaaa3202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ae04d96-b4dc-4acf-9f79-4f6644c1a082", "name": "network-vif-unplugged", "status": "completed", "tag": "67e59d38-b12f-4f51-bb79-591d93062336"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:46:08.714513 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-01b518fc-7508-4526-80bb-af4c04879001 req-d5026ced-86cb-454a-9623-102cdaaa3202 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:08.716774 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-01b518fc-7508-4526-80bb-af4c04879001 req-d5026ced-86cb-454a-9623-102cdaaa3202 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:08.717958 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-01b518fc-7508-4526-80bb-af4c04879001 req-d5026ced-86cb-454a-9623-102cdaaa3202 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:08.729773 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.compute.server_external_events [req-01b518fc-7508-4526-80bb-af4c04879001 req-d5026ced-86cb-454a-9623-102cdaaa3202 service nova] Unable to find a host for instance 8ae04d96-b4dc-4acf-9f79-4f6644c1a082. Dropping event network-vif-unplugged {{(pid=127142) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 25 04:46:08.730732 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-01b518fc-7508-4526-80bb-af4c04879001 req-d5026ced-86cb-454a-9623-102cdaaa3202 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.038611 Sep 25 04:46:08.731322 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 545/1022] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 40 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 25 04:46:08.915719 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-1ddd6d28-02d1-4bdb-9c8d-9b5bf989a635 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:08.916344 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-1ddd6d28-02d1-4bdb-9c8d-9b5bf989a635 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:08.923492 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1ddd6d28-02d1-4bdb-9c8d-9b5bf989a635 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:08.923983 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1ddd6d28-02d1-4bdb-9c8d-9b5bf989a635 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:08.924427 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1ddd6d28-02d1-4bdb-9c8d-9b5bf989a635 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:08.925156 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1ddd6d28-02d1-4bdb-9c8d-9b5bf989a635 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:08.925622 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1ddd6d28-02d1-4bdb-9c8d-9b5bf989a635 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:08.926053 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1ddd6d28-02d1-4bdb-9c8d-9b5bf989a635 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:09.061780 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-1ddd6d28-02d1-4bdb-9c8d-9b5bf989a635 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:09.070266 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-1ddd6d28-02d1-4bdb-9c8d-9b5bf989a635 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:09.071732 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-1ddd6d28-02d1-4bdb-9c8d-9b5bf989a635 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:09.072912 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-1ddd6d28-02d1-4bdb-9c8d-9b5bf989a635 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1665 microversion: 2.20 time: 0.161323 Sep 25 04:46:09.073546 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 478/1023] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:46:08 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1665 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:46:09.099190 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-3597a8b6-6b41-43a1-b8f0-492113742fa0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3be95cb8-4c31-4f6c-ab72-987a1de8cdbe"}} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:46:09.101649 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-3597a8b6-6b41-43a1-b8f0-492113742fa0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:09.108784 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3597a8b6-6b41-43a1-b8f0-492113742fa0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:09.109282 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3597a8b6-6b41-43a1-b8f0-492113742fa0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:09.109754 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3597a8b6-6b41-43a1-b8f0-492113742fa0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:09.110461 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3597a8b6-6b41-43a1-b8f0-492113742fa0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:09.110923 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3597a8b6-6b41-43a1-b8f0-492113742fa0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:09.111355 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3597a8b6-6b41-43a1-b8f0-492113742fa0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:09.401055 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-3597a8b6-6b41-43a1-b8f0-492113742fa0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "POST /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.305711 Sep 25 04:46:09.401682 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 546/1024] 10.222.0.25 () {62 vars in 1364 bytes} [Sun Sep 25 04:46:09 2022] POST /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082/os-volume_attachments => generated 188 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 04:46:09.534363 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-ec2f4bfc-90d5-4725-bcb4-51fc174e43d2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:09.534862 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-ec2f4bfc-90d5-4725-bcb4-51fc174e43d2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:09.540867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ec2f4bfc-90d5-4725-bcb4-51fc174e43d2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:09.541403 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ec2f4bfc-90d5-4725-bcb4-51fc174e43d2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:09.541919 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ec2f4bfc-90d5-4725-bcb4-51fc174e43d2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:09.542710 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ec2f4bfc-90d5-4725-bcb4-51fc174e43d2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:09.543266 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ec2f4bfc-90d5-4725-bcb4-51fc174e43d2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:09.543758 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ec2f4bfc-90d5-4725-bcb4-51fc174e43d2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:09.814239 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-ec2f4bfc-90d5-4725-bcb4-51fc174e43d2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082/os-volume_attachments/3be95cb8-4c31-4f6c-ab72-987a1de8cdbe" status: 202 len: 0 microversion: 2.20 time: 0.284532 Sep 25 04:46:09.814858 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 479/1025] 10.222.0.25 () {60 vars in 1457 bytes} [Sun Sep 25 04:46:09 2022] DELETE /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082/os-volume_attachments/3be95cb8-4c31-4f6c-ab72-987a1de8cdbe => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 25 04:46:09.879362 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-5885a6c4-6d0f-4d6a-8bd6-1ae5d8264810 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:46:09.879963 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-5885a6c4-6d0f-4d6a-8bd6-1ae5d8264810 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:09.886492 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5885a6c4-6d0f-4d6a-8bd6-1ae5d8264810 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:09.886977 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5885a6c4-6d0f-4d6a-8bd6-1ae5d8264810 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:09.887418 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5885a6c4-6d0f-4d6a-8bd6-1ae5d8264810 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:09.888114 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5885a6c4-6d0f-4d6a-8bd6-1ae5d8264810 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:09.889124 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5885a6c4-6d0f-4d6a-8bd6-1ae5d8264810 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:09.889787 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5885a6c4-6d0f-4d6a-8bd6-1ae5d8264810 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:09.921457 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-5885a6c4-6d0f-4d6a-8bd6-1ae5d8264810 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127142) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 25 04:46:09.991242 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-5885a6c4-6d0f-4d6a-8bd6-1ae5d8264810 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "POST /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082/action" status: 202 len: 0 microversion: 2.20 time: 0.115592 Sep 25 04:46:09.992053 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 547/1026] 10.222.0.25 () {62 vars in 1319 bytes} [Sun Sep 25 04:46:09 2022] POST /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 25 04:46:10.000179 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-f622c0b5-b08c-4f05-9ba0-27665f54e966 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:10.000906 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-f622c0b5-b08c-4f05-9ba0-27665f54e966 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:10.007834 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f622c0b5-b08c-4f05-9ba0-27665f54e966 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:10.008437 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f622c0b5-b08c-4f05-9ba0-27665f54e966 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:10.009013 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f622c0b5-b08c-4f05-9ba0-27665f54e966 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:10.009821 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f622c0b5-b08c-4f05-9ba0-27665f54e966 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:10.010508 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f622c0b5-b08c-4f05-9ba0-27665f54e966 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:10.011164 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f622c0b5-b08c-4f05-9ba0-27665f54e966 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:10.158763 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-f622c0b5-b08c-4f05-9ba0-27665f54e966 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:10.169762 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-f622c0b5-b08c-4f05-9ba0-27665f54e966 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:10.171675 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-f622c0b5-b08c-4f05-9ba0-27665f54e966 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:10.172881 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-f622c0b5-b08c-4f05-9ba0-27665f54e966 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1673 microversion: 2.20 time: 0.176730 Sep 25 04:46:10.173529 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 480/1027] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:46:09 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1673 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 04:46:11.199791 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-90a4ab4f-f392-4d1c-bf39-b051b2d22a1e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:11.200543 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-90a4ab4f-f392-4d1c-bf39-b051b2d22a1e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:11.207509 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-90a4ab4f-f392-4d1c-bf39-b051b2d22a1e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:11.208216 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-90a4ab4f-f392-4d1c-bf39-b051b2d22a1e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:11.208892 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-90a4ab4f-f392-4d1c-bf39-b051b2d22a1e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:11.209946 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-90a4ab4f-f392-4d1c-bf39-b051b2d22a1e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:11.210582 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-90a4ab4f-f392-4d1c-bf39-b051b2d22a1e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:11.211164 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-90a4ab4f-f392-4d1c-bf39-b051b2d22a1e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:11.347986 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-90a4ab4f-f392-4d1c-bf39-b051b2d22a1e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:11.356340 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-90a4ab4f-f392-4d1c-bf39-b051b2d22a1e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:11.358026 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-90a4ab4f-f392-4d1c-bf39-b051b2d22a1e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:11.359401 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-90a4ab4f-f392-4d1c-bf39-b051b2d22a1e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1675 microversion: 2.20 time: 0.164006 Sep 25 04:46:11.359895 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 548/1028] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:46:11 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:46:12.386205 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-f0bfdb53-f5fe-43bb-ade0-2668b3cbe373 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:12.386812 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-f0bfdb53-f5fe-43bb-ade0-2668b3cbe373 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:12.393815 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f0bfdb53-f5fe-43bb-ade0-2668b3cbe373 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:12.394301 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f0bfdb53-f5fe-43bb-ade0-2668b3cbe373 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:12.394930 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f0bfdb53-f5fe-43bb-ade0-2668b3cbe373 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:12.396599 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f0bfdb53-f5fe-43bb-ade0-2668b3cbe373 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:12.397129 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f0bfdb53-f5fe-43bb-ade0-2668b3cbe373 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:12.397752 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f0bfdb53-f5fe-43bb-ade0-2668b3cbe373 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:12.402608 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:46:12.539523 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-f0bfdb53-f5fe-43bb-ade0-2668b3cbe373 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:12.548417 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-f0bfdb53-f5fe-43bb-ade0-2668b3cbe373 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:12.549916 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-f0bfdb53-f5fe-43bb-ade0-2668b3cbe373 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:12.551085 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-f0bfdb53-f5fe-43bb-ade0-2668b3cbe373 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1731 microversion: 2.20 time: 0.169146 Sep 25 04:46:12.551648 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 481/1029] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:46:12 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:46:13.579455 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-7124cd1d-2913-48f0-9989-7f2ae7b03e00 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:13.580025 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-7124cd1d-2913-48f0-9989-7f2ae7b03e00 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:13.587102 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7124cd1d-2913-48f0-9989-7f2ae7b03e00 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:13.587584 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7124cd1d-2913-48f0-9989-7f2ae7b03e00 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:13.588015 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7124cd1d-2913-48f0-9989-7f2ae7b03e00 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:13.588889 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7124cd1d-2913-48f0-9989-7f2ae7b03e00 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:13.589339 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7124cd1d-2913-48f0-9989-7f2ae7b03e00 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:13.590370 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7124cd1d-2913-48f0-9989-7f2ae7b03e00 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:13.607292 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:46:13.749860 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-7124cd1d-2913-48f0-9989-7f2ae7b03e00 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:13.774804 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-7124cd1d-2913-48f0-9989-7f2ae7b03e00 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:13.776242 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-7124cd1d-2913-48f0-9989-7f2ae7b03e00 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:13.777449 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-7124cd1d-2913-48f0-9989-7f2ae7b03e00 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1731 microversion: 2.20 time: 0.202758 Sep 25 04:46:13.777996 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 549/1030] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:46:13 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1731 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:46:14.803378 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-c1dbfff4-6f15-40c6-b2af-d510374c6784 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:14.803979 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-c1dbfff4-6f15-40c6-b2af-d510374c6784 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:14.811238 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c1dbfff4-6f15-40c6-b2af-d510374c6784 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:14.811875 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c1dbfff4-6f15-40c6-b2af-d510374c6784 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:14.812302 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c1dbfff4-6f15-40c6-b2af-d510374c6784 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:14.813017 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c1dbfff4-6f15-40c6-b2af-d510374c6784 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:14.813469 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c1dbfff4-6f15-40c6-b2af-d510374c6784 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:14.813888 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c1dbfff4-6f15-40c6-b2af-d510374c6784 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:14.958572 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-c1dbfff4-6f15-40c6-b2af-d510374c6784 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:14.968375 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-c1dbfff4-6f15-40c6-b2af-d510374c6784 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:14.969895 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-c1dbfff4-6f15-40c6-b2af-d510374c6784 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:14.971130 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-c1dbfff4-6f15-40c6-b2af-d510374c6784 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1731 microversion: 2.20 time: 0.171658 Sep 25 04:46:14.971682 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 482/1031] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:46:14 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:46:15.995720 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-cc405bcb-6d94-4f36-a93e-6f0480d2a045 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:15.996339 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-cc405bcb-6d94-4f36-a93e-6f0480d2a045 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:16.003895 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cc405bcb-6d94-4f36-a93e-6f0480d2a045 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:16.004389 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cc405bcb-6d94-4f36-a93e-6f0480d2a045 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:16.004860 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cc405bcb-6d94-4f36-a93e-6f0480d2a045 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:16.005567 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cc405bcb-6d94-4f36-a93e-6f0480d2a045 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:16.006017 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cc405bcb-6d94-4f36-a93e-6f0480d2a045 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:16.006440 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cc405bcb-6d94-4f36-a93e-6f0480d2a045 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:16.159258 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-cc405bcb-6d94-4f36-a93e-6f0480d2a045 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:16.167284 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-cc405bcb-6d94-4f36-a93e-6f0480d2a045 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:16.168836 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-cc405bcb-6d94-4f36-a93e-6f0480d2a045 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:16.170147 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-cc405bcb-6d94-4f36-a93e-6f0480d2a045 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1731 microversion: 2.20 time: 0.178188 Sep 25 04:46:16.170708 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 550/1032] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:46:15 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:46:17.195881 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-17b36bcd-d8dd-4df0-ac6d-a6c4ac05a6a2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:17.196500 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-17b36bcd-d8dd-4df0-ac6d-a6c4ac05a6a2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:17.204330 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-17b36bcd-d8dd-4df0-ac6d-a6c4ac05a6a2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:17.204860 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-17b36bcd-d8dd-4df0-ac6d-a6c4ac05a6a2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:17.205307 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-17b36bcd-d8dd-4df0-ac6d-a6c4ac05a6a2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:17.206022 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-17b36bcd-d8dd-4df0-ac6d-a6c4ac05a6a2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:17.206487 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-17b36bcd-d8dd-4df0-ac6d-a6c4ac05a6a2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:17.206959 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-17b36bcd-d8dd-4df0-ac6d-a6c4ac05a6a2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:17.355344 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-17b36bcd-d8dd-4df0-ac6d-a6c4ac05a6a2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:17.365433 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-17b36bcd-d8dd-4df0-ac6d-a6c4ac05a6a2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:17.367976 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-17b36bcd-d8dd-4df0-ac6d-a6c4ac05a6a2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:17.370001 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-17b36bcd-d8dd-4df0-ac6d-a6c4ac05a6a2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1731 microversion: 2.20 time: 0.177813 Sep 25 04:46:17.371253 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 483/1033] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:46:17 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:46:18.395831 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-e62cc3d5-c5a2-4c7d-975e-4327ab41e824 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:18.396488 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-e62cc3d5-c5a2-4c7d-975e-4327ab41e824 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:18.404319 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e62cc3d5-c5a2-4c7d-975e-4327ab41e824 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:18.405452 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e62cc3d5-c5a2-4c7d-975e-4327ab41e824 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:18.406018 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e62cc3d5-c5a2-4c7d-975e-4327ab41e824 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:18.407016 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e62cc3d5-c5a2-4c7d-975e-4327ab41e824 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:18.407480 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e62cc3d5-c5a2-4c7d-975e-4327ab41e824 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:18.407908 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e62cc3d5-c5a2-4c7d-975e-4327ab41e824 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:18.545745 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-e62cc3d5-c5a2-4c7d-975e-4327ab41e824 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:18.556954 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-e62cc3d5-c5a2-4c7d-975e-4327ab41e824 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:18.558502 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-e62cc3d5-c5a2-4c7d-975e-4327ab41e824 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:18.559685 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-e62cc3d5-c5a2-4c7d-975e-4327ab41e824 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1731 microversion: 2.20 time: 0.167839 Sep 25 04:46:18.560240 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 551/1034] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:46:18 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:46:19.585070 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-ec8d527d-c56e-4416-97b3-7c2ea91caba9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:19.585718 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-ec8d527d-c56e-4416-97b3-7c2ea91caba9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:19.592014 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ec8d527d-c56e-4416-97b3-7c2ea91caba9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:19.592505 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ec8d527d-c56e-4416-97b3-7c2ea91caba9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:19.593228 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ec8d527d-c56e-4416-97b3-7c2ea91caba9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:19.594158 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ec8d527d-c56e-4416-97b3-7c2ea91caba9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:19.594619 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ec8d527d-c56e-4416-97b3-7c2ea91caba9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:19.595048 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ec8d527d-c56e-4416-97b3-7c2ea91caba9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:19.747454 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-ec8d527d-c56e-4416-97b3-7c2ea91caba9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:19.756210 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-ec8d527d-c56e-4416-97b3-7c2ea91caba9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:19.757696 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-ec8d527d-c56e-4416-97b3-7c2ea91caba9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:19.758857 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-ec8d527d-c56e-4416-97b3-7c2ea91caba9 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1731 microversion: 2.20 time: 0.177823 Sep 25 04:46:19.759418 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 484/1035] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:46:19 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:46:20.788801 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-46edf0ae-f79d-4869-a549-113ae81f2ccb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:20.788801 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-46edf0ae-f79d-4869-a549-113ae81f2ccb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:20.793878 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-46edf0ae-f79d-4869-a549-113ae81f2ccb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:20.794381 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-46edf0ae-f79d-4869-a549-113ae81f2ccb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:20.795098 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-46edf0ae-f79d-4869-a549-113ae81f2ccb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:20.795969 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-46edf0ae-f79d-4869-a549-113ae81f2ccb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:20.796676 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-46edf0ae-f79d-4869-a549-113ae81f2ccb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:20.797107 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-46edf0ae-f79d-4869-a549-113ae81f2ccb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:20.932961 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-46edf0ae-f79d-4869-a549-113ae81f2ccb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:20.942308 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-46edf0ae-f79d-4869-a549-113ae81f2ccb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:20.943759 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-46edf0ae-f79d-4869-a549-113ae81f2ccb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:20.944959 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-46edf0ae-f79d-4869-a549-113ae81f2ccb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1731 microversion: 2.20 time: 0.162306 Sep 25 04:46:20.945520 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 552/1036] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:46:20 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:46:21.972560 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-bcde16f9-efb6-4b9c-9e8c-b82a972a8373 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:21.973204 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-bcde16f9-efb6-4b9c-9e8c-b82a972a8373 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:21.979788 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bcde16f9-efb6-4b9c-9e8c-b82a972a8373 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:21.980276 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bcde16f9-efb6-4b9c-9e8c-b82a972a8373 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:21.980749 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bcde16f9-efb6-4b9c-9e8c-b82a972a8373 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:21.981444 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bcde16f9-efb6-4b9c-9e8c-b82a972a8373 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:21.981905 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bcde16f9-efb6-4b9c-9e8c-b82a972a8373 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:21.982336 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bcde16f9-efb6-4b9c-9e8c-b82a972a8373 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:22.126632 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-bcde16f9-efb6-4b9c-9e8c-b82a972a8373 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:22.134978 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-bcde16f9-efb6-4b9c-9e8c-b82a972a8373 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:22.136409 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-bcde16f9-efb6-4b9c-9e8c-b82a972a8373 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:22.137699 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-bcde16f9-efb6-4b9c-9e8c-b82a972a8373 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1731 microversion: 2.20 time: 0.170041 Sep 25 04:46:22.138276 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 485/1037] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:46:21 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:46:23.164619 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-8b4b022c-98af-4842-b3be-9404cecef629 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:23.165322 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-8b4b022c-98af-4842-b3be-9404cecef629 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:23.172194 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8b4b022c-98af-4842-b3be-9404cecef629 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:23.172711 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8b4b022c-98af-4842-b3be-9404cecef629 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:23.173158 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8b4b022c-98af-4842-b3be-9404cecef629 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:23.173860 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8b4b022c-98af-4842-b3be-9404cecef629 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:23.174314 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8b4b022c-98af-4842-b3be-9404cecef629 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:23.174739 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8b4b022c-98af-4842-b3be-9404cecef629 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:23.307267 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-8b4b022c-98af-4842-b3be-9404cecef629 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:23.316143 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-8b4b022c-98af-4842-b3be-9404cecef629 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:23.317620 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-8b4b022c-98af-4842-b3be-9404cecef629 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:23.318788 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-8b4b022c-98af-4842-b3be-9404cecef629 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1731 microversion: 2.20 time: 0.158153 Sep 25 04:46:23.330563 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 553/1038] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:46:23 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:46:24.345250 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-459bbc11-77ef-4607-b610-9d47c8efeae6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:24.346505 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-459bbc11-77ef-4607-b610-9d47c8efeae6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:24.353326 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-459bbc11-77ef-4607-b610-9d47c8efeae6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:24.353815 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-459bbc11-77ef-4607-b610-9d47c8efeae6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:24.354250 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-459bbc11-77ef-4607-b610-9d47c8efeae6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:24.355149 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-459bbc11-77ef-4607-b610-9d47c8efeae6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:24.355636 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-459bbc11-77ef-4607-b610-9d47c8efeae6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:24.356036 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-459bbc11-77ef-4607-b610-9d47c8efeae6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:24.500358 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-459bbc11-77ef-4607-b610-9d47c8efeae6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:24.508859 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-459bbc11-77ef-4607-b610-9d47c8efeae6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:24.510262 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-459bbc11-77ef-4607-b610-9d47c8efeae6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:24.511437 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-459bbc11-77ef-4607-b610-9d47c8efeae6 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1731 microversion: 2.20 time: 0.170791 Sep 25 04:46:24.512197 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 486/1039] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:46:24 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:46:25.537349 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-672a927a-4e17-4509-aa9f-e2d356bd2622 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:25.537951 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-672a927a-4e17-4509-aa9f-e2d356bd2622 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:25.544353 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-672a927a-4e17-4509-aa9f-e2d356bd2622 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:25.544865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-672a927a-4e17-4509-aa9f-e2d356bd2622 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:25.545301 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-672a927a-4e17-4509-aa9f-e2d356bd2622 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:25.546844 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-672a927a-4e17-4509-aa9f-e2d356bd2622 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:25.547306 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-672a927a-4e17-4509-aa9f-e2d356bd2622 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:25.547730 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-672a927a-4e17-4509-aa9f-e2d356bd2622 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:25.677743 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-672a927a-4e17-4509-aa9f-e2d356bd2622 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:25.685778 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-672a927a-4e17-4509-aa9f-e2d356bd2622 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:25.687275 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-672a927a-4e17-4509-aa9f-e2d356bd2622 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:25.688427 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-672a927a-4e17-4509-aa9f-e2d356bd2622 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1731 microversion: 2.20 time: 0.154972 Sep 25 04:46:25.689012 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 554/1040] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:46:25 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:46:26.714275 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-ff06daa9-9e2a-4146-b2f4-fc547976809b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:26.715151 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-ff06daa9-9e2a-4146-b2f4-fc547976809b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:26.722583 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ff06daa9-9e2a-4146-b2f4-fc547976809b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:26.723066 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ff06daa9-9e2a-4146-b2f4-fc547976809b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:26.723505 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ff06daa9-9e2a-4146-b2f4-fc547976809b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:26.724198 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ff06daa9-9e2a-4146-b2f4-fc547976809b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:26.724670 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ff06daa9-9e2a-4146-b2f4-fc547976809b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:26.725102 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ff06daa9-9e2a-4146-b2f4-fc547976809b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:26.855110 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-ff06daa9-9e2a-4146-b2f4-fc547976809b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:26.863951 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-ff06daa9-9e2a-4146-b2f4-fc547976809b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:26.865424 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-ff06daa9-9e2a-4146-b2f4-fc547976809b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:26.866585 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-ff06daa9-9e2a-4146-b2f4-fc547976809b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1731 microversion: 2.20 time: 0.156236 Sep 25 04:46:26.867149 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 487/1041] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:46:26 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:46:27.892078 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-44da812a-bbb7-41d6-aa8e-c895b06871d0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:27.892764 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-44da812a-bbb7-41d6-aa8e-c895b06871d0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:27.899405 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-44da812a-bbb7-41d6-aa8e-c895b06871d0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:27.899884 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-44da812a-bbb7-41d6-aa8e-c895b06871d0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:27.900312 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-44da812a-bbb7-41d6-aa8e-c895b06871d0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:27.901022 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-44da812a-bbb7-41d6-aa8e-c895b06871d0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:27.901505 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-44da812a-bbb7-41d6-aa8e-c895b06871d0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:27.901927 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-44da812a-bbb7-41d6-aa8e-c895b06871d0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:28.268282 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-44da812a-bbb7-41d6-aa8e-c895b06871d0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:28.276381 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-44da812a-bbb7-41d6-aa8e-c895b06871d0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:28.277855 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-44da812a-bbb7-41d6-aa8e-c895b06871d0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:28.279007 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-44da812a-bbb7-41d6-aa8e-c895b06871d0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1731 microversion: 2.20 time: 0.391621 Sep 25 04:46:28.279565 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 555/1042] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:46:27 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1731 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:46:29.304030 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-9a1762be-c315-4a45-800b-56944db2c4da tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:29.304650 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-9a1762be-c315-4a45-800b-56944db2c4da tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:29.306944 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_api:SELECT=34 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:46:29.312584 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9a1762be-c315-4a45-800b-56944db2c4da tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:29.313090 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9a1762be-c315-4a45-800b-56944db2c4da tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:29.313531 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9a1762be-c315-4a45-800b-56944db2c4da tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:29.314221 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9a1762be-c315-4a45-800b-56944db2c4da tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:29.314677 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9a1762be-c315-4a45-800b-56944db2c4da tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:29.315163 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9a1762be-c315-4a45-800b-56944db2c4da tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:29.443212 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-9a1762be-c315-4a45-800b-56944db2c4da tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:29.451296 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-9a1762be-c315-4a45-800b-56944db2c4da tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:29.453287 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-9a1762be-c315-4a45-800b-56944db2c4da tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:29.454449 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-9a1762be-c315-4a45-800b-56944db2c4da tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1731 microversion: 2.20 time: 0.154405 Sep 25 04:46:29.454999 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 488/1043] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:46:29 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:46:30.479858 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-88ef69cb-fa30-4d97-9724-4f5841da1501 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:30.480710 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-88ef69cb-fa30-4d97-9724-4f5841da1501 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:30.483133 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:46:30.488368 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-88ef69cb-fa30-4d97-9724-4f5841da1501 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:30.488892 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-88ef69cb-fa30-4d97-9724-4f5841da1501 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:30.489336 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-88ef69cb-fa30-4d97-9724-4f5841da1501 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:30.490027 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-88ef69cb-fa30-4d97-9724-4f5841da1501 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:30.490511 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-88ef69cb-fa30-4d97-9724-4f5841da1501 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:30.490940 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-88ef69cb-fa30-4d97-9724-4f5841da1501 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:30.622835 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-88ef69cb-fa30-4d97-9724-4f5841da1501 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:30.631682 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-88ef69cb-fa30-4d97-9724-4f5841da1501 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:30.633219 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-88ef69cb-fa30-4d97-9724-4f5841da1501 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:30.634378 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-88ef69cb-fa30-4d97-9724-4f5841da1501 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1731 microversion: 2.20 time: 0.158438 Sep 25 04:46:30.634933 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 556/1044] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:46:30 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:46:31.660915 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-49292d37-0cc5-4857-9718-c25178770bac tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:31.661529 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-49292d37-0cc5-4857-9718-c25178770bac tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:31.668038 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-49292d37-0cc5-4857-9718-c25178770bac tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:31.668532 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-49292d37-0cc5-4857-9718-c25178770bac tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:31.669007 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-49292d37-0cc5-4857-9718-c25178770bac tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:31.669704 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-49292d37-0cc5-4857-9718-c25178770bac tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:31.670227 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-49292d37-0cc5-4857-9718-c25178770bac tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:31.670642 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-49292d37-0cc5-4857-9718-c25178770bac tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:31.803490 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-49292d37-0cc5-4857-9718-c25178770bac tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:31.813659 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-49292d37-0cc5-4857-9718-c25178770bac tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:31.815092 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-49292d37-0cc5-4857-9718-c25178770bac tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:31.816245 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-49292d37-0cc5-4857-9718-c25178770bac tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1731 microversion: 2.20 time: 0.159315 Sep 25 04:46:31.816820 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 489/1045] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:46:31 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:46:32.841910 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-f09d012d-f521-4d58-86ab-5c3b26996b96 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:32.843033 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-f09d012d-f521-4d58-86ab-5c3b26996b96 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:32.849673 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f09d012d-f521-4d58-86ab-5c3b26996b96 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:32.850161 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f09d012d-f521-4d58-86ab-5c3b26996b96 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:32.850600 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f09d012d-f521-4d58-86ab-5c3b26996b96 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:32.851292 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f09d012d-f521-4d58-86ab-5c3b26996b96 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:32.851760 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f09d012d-f521-4d58-86ab-5c3b26996b96 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:32.852185 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f09d012d-f521-4d58-86ab-5c3b26996b96 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:32.978335 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-f09d012d-f521-4d58-86ab-5c3b26996b96 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:32.987485 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-f09d012d-f521-4d58-86ab-5c3b26996b96 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:32.988962 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-f09d012d-f521-4d58-86ab-5c3b26996b96 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:32.990116 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-f09d012d-f521-4d58-86ab-5c3b26996b96 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1731 microversion: 2.20 time: 0.152560 Sep 25 04:46:32.990672 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 557/1046] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:46:32 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:46:34.015787 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-09678350-0693-41ff-96ed-529afb54136a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:34.016336 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-09678350-0693-41ff-96ed-529afb54136a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:34.023011 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-09678350-0693-41ff-96ed-529afb54136a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:34.023499 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-09678350-0693-41ff-96ed-529afb54136a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:34.023936 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-09678350-0693-41ff-96ed-529afb54136a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:34.024622 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-09678350-0693-41ff-96ed-529afb54136a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:34.025099 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-09678350-0693-41ff-96ed-529afb54136a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:34.025521 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-09678350-0693-41ff-96ed-529afb54136a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:34.155519 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-09678350-0693-41ff-96ed-529afb54136a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:34.163918 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-09678350-0693-41ff-96ed-529afb54136a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:34.165397 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-09678350-0693-41ff-96ed-529afb54136a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:34.166545 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-09678350-0693-41ff-96ed-529afb54136a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1731 microversion: 2.20 time: 0.155164 Sep 25 04:46:34.167096 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 490/1047] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:46:34 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:46:35.192915 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-2f3f376b-b0c5-4829-ab8a-39aa2bcdbbb8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:35.193434 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-2f3f376b-b0c5-4829-ab8a-39aa2bcdbbb8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:35.199954 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2f3f376b-b0c5-4829-ab8a-39aa2bcdbbb8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:35.200436 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2f3f376b-b0c5-4829-ab8a-39aa2bcdbbb8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:35.200906 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2f3f376b-b0c5-4829-ab8a-39aa2bcdbbb8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:35.202413 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2f3f376b-b0c5-4829-ab8a-39aa2bcdbbb8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:35.202987 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2f3f376b-b0c5-4829-ab8a-39aa2bcdbbb8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:35.203421 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2f3f376b-b0c5-4829-ab8a-39aa2bcdbbb8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:35.330330 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-2f3f376b-b0c5-4829-ab8a-39aa2bcdbbb8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:35.338547 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-2f3f376b-b0c5-4829-ab8a-39aa2bcdbbb8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:35.340252 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-2f3f376b-b0c5-4829-ab8a-39aa2bcdbbb8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:35.341440 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-2f3f376b-b0c5-4829-ab8a-39aa2bcdbbb8 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1731 microversion: 2.20 time: 0.152582 Sep 25 04:46:35.342045 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 558/1048] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:46:35 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:46:36.367732 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-3bd7dff2-f7cd-493c-bd2e-03421610c104 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:36.368356 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-3bd7dff2-f7cd-493c-bd2e-03421610c104 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:36.374913 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3bd7dff2-f7cd-493c-bd2e-03421610c104 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:36.375392 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3bd7dff2-f7cd-493c-bd2e-03421610c104 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:36.375822 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3bd7dff2-f7cd-493c-bd2e-03421610c104 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:36.376501 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3bd7dff2-f7cd-493c-bd2e-03421610c104 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:36.376988 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3bd7dff2-f7cd-493c-bd2e-03421610c104 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:36.377412 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3bd7dff2-f7cd-493c-bd2e-03421610c104 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:36.510270 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-3bd7dff2-f7cd-493c-bd2e-03421610c104 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:36.518962 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-3bd7dff2-f7cd-493c-bd2e-03421610c104 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:36.520396 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-3bd7dff2-f7cd-493c-bd2e-03421610c104 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:36.521566 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-3bd7dff2-f7cd-493c-bd2e-03421610c104 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1731 microversion: 2.20 time: 0.157876 Sep 25 04:46:36.522122 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 491/1049] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:46:36 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:46:37.546956 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-6ba86ae2-a478-4ca8-9f89-7157839a65cd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:37.547592 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-6ba86ae2-a478-4ca8-9f89-7157839a65cd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:37.554178 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6ba86ae2-a478-4ca8-9f89-7157839a65cd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:37.554667 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6ba86ae2-a478-4ca8-9f89-7157839a65cd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:37.555105 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6ba86ae2-a478-4ca8-9f89-7157839a65cd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:37.555795 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6ba86ae2-a478-4ca8-9f89-7157839a65cd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:37.556259 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6ba86ae2-a478-4ca8-9f89-7157839a65cd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:37.556718 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6ba86ae2-a478-4ca8-9f89-7157839a65cd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:37.689487 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-6ba86ae2-a478-4ca8-9f89-7157839a65cd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:37.697697 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-6ba86ae2-a478-4ca8-9f89-7157839a65cd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:37.699151 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-6ba86ae2-a478-4ca8-9f89-7157839a65cd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:37.700319 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-6ba86ae2-a478-4ca8-9f89-7157839a65cd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1731 microversion: 2.20 time: 0.157944 Sep 25 04:46:37.702100 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 559/1050] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:46:37 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:46:38.728303 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-9aed2862-8bbe-439e-ba94-c77a6d1d7801 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:38.728954 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-9aed2862-8bbe-439e-ba94-c77a6d1d7801 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:38.736435 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9aed2862-8bbe-439e-ba94-c77a6d1d7801 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:38.736892 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9aed2862-8bbe-439e-ba94-c77a6d1d7801 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:38.737333 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9aed2862-8bbe-439e-ba94-c77a6d1d7801 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:38.738027 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9aed2862-8bbe-439e-ba94-c77a6d1d7801 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:38.738483 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9aed2862-8bbe-439e-ba94-c77a6d1d7801 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:38.738910 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9aed2862-8bbe-439e-ba94-c77a6d1d7801 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:38.872037 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-9aed2862-8bbe-439e-ba94-c77a6d1d7801 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:38.880540 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-9aed2862-8bbe-439e-ba94-c77a6d1d7801 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:38.882033 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-9aed2862-8bbe-439e-ba94-c77a6d1d7801 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:38.883269 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-9aed2862-8bbe-439e-ba94-c77a6d1d7801 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1731 microversion: 2.20 time: 0.158844 Sep 25 04:46:38.883831 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 492/1051] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:46:38 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:46:39.907351 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-cb8f395d-b042-4410-9b50-f67c38008e54 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:39.907963 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-cb8f395d-b042-4410-9b50-f67c38008e54 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:39.914475 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cb8f395d-b042-4410-9b50-f67c38008e54 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:39.914960 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cb8f395d-b042-4410-9b50-f67c38008e54 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:39.915401 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cb8f395d-b042-4410-9b50-f67c38008e54 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:39.916090 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cb8f395d-b042-4410-9b50-f67c38008e54 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:39.916548 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cb8f395d-b042-4410-9b50-f67c38008e54 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:39.917000 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cb8f395d-b042-4410-9b50-f67c38008e54 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:40.056199 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-cb8f395d-b042-4410-9b50-f67c38008e54 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:40.065104 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-cb8f395d-b042-4410-9b50-f67c38008e54 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:40.066556 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-cb8f395d-b042-4410-9b50-f67c38008e54 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:40.067706 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-cb8f395d-b042-4410-9b50-f67c38008e54 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1731 microversion: 2.20 time: 0.164386 Sep 25 04:46:40.068267 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 560/1052] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:46:39 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:46:40.787317 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-ce842d34-634b-463d-bb75-73c8334c8b7f tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:40.789917 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-ce842d34-634b-463d-bb75-73c8334c8b7f tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: ffac6eac-431f-426a-9819-d3a16eebbd6e] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:40.796875 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ce842d34-634b-463d-bb75-73c8334c8b7f tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:40.797369 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ce842d34-634b-463d-bb75-73c8334c8b7f tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:40.797813 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ce842d34-634b-463d-bb75-73c8334c8b7f tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:40.798543 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ce842d34-634b-463d-bb75-73c8334c8b7f tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:40.799047 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ce842d34-634b-463d-bb75-73c8334c8b7f tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:40.799421 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ce842d34-634b-463d-bb75-73c8334c8b7f tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:40.833444 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-ce842d34-634b-463d-bb75-73c8334c8b7f tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050040 Sep 25 04:46:40.834403 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 493/1053] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 25 04:46:40 2022] GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:46:40.982881 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-cec55477-c2b2-46be-8da6-ecc70fe09e11 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:40.983429 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-cec55477-c2b2-46be-8da6-ecc70fe09e11 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: ffac6eac-431f-426a-9819-d3a16eebbd6e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:40.989893 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cec55477-c2b2-46be-8da6-ecc70fe09e11 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:40.990376 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cec55477-c2b2-46be-8da6-ecc70fe09e11 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:40.990812 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cec55477-c2b2-46be-8da6-ecc70fe09e11 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:40.991503 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cec55477-c2b2-46be-8da6-ecc70fe09e11 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:40.991953 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cec55477-c2b2-46be-8da6-ecc70fe09e11 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:40.992375 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cec55477-c2b2-46be-8da6-ecc70fe09e11 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:41.021756 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-cec55477-c2b2-46be-8da6-ecc70fe09e11 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e/os-volume_attachments/af3c6701-db57-4e83-b9fb-53b06b04f96c" status: 200 len: 194 microversion: 2.1 time: 0.043002 Sep 25 04:46:41.022331 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 561/1054] 10.222.0.25 () {58 vars in 1413 bytes} [Sun Sep 25 04:46:40 2022] GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e/os-volume_attachments/af3c6701-db57-4e83-b9fb-53b06b04f96c => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 04:46:41.034937 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-632a513a-9470-46f7-9561-ab865a55c4f8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:41.035434 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-632a513a-9470-46f7-9561-ab865a55c4f8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: ffac6eac-431f-426a-9819-d3a16eebbd6e] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:41.041685 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-632a513a-9470-46f7-9561-ab865a55c4f8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:41.042176 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-632a513a-9470-46f7-9561-ab865a55c4f8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:41.042657 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-632a513a-9470-46f7-9561-ab865a55c4f8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:41.043355 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-632a513a-9470-46f7-9561-ab865a55c4f8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:41.043912 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-632a513a-9470-46f7-9561-ab865a55c4f8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:41.044342 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-632a513a-9470-46f7-9561-ab865a55c4f8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:41.094239 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-8cfa6052-4941-4f6e-b880-5569fc2da347 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:41.094954 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-8cfa6052-4941-4f6e-b880-5569fc2da347 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:41.101110 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8cfa6052-4941-4f6e-b880-5569fc2da347 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:41.101681 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8cfa6052-4941-4f6e-b880-5569fc2da347 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:41.102358 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8cfa6052-4941-4f6e-b880-5569fc2da347 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:41.103296 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8cfa6052-4941-4f6e-b880-5569fc2da347 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:41.104180 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8cfa6052-4941-4f6e-b880-5569fc2da347 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:41.104706 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-8cfa6052-4941-4f6e-b880-5569fc2da347 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:41.131961 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.objects.instance [None req-632a513a-9470-46f7-9561-ab865a55c4f8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lazy-loading 'services' on Instance uuid ffac6eac-431f-426a-9819-d3a16eebbd6e {{(pid=127141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 04:46:41.208719 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-632a513a-9470-46f7-9561-ab865a55c4f8 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e/os-volume_attachments/af3c6701-db57-4e83-b9fb-53b06b04f96c" status: 202 len: 0 microversion: 2.1 time: 0.179830 Sep 25 04:46:41.209317 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 494/1055] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Sep 25 04:46:41 2022] DELETE /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e/os-volume_attachments/af3c6701-db57-4e83-b9fb-53b06b04f96c => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 04:46:41.247510 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-8cfa6052-4941-4f6e-b880-5569fc2da347 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:41.257958 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-8cfa6052-4941-4f6e-b880-5569fc2da347 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:41.259435 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-8cfa6052-4941-4f6e-b880-5569fc2da347 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:41.260814 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-8cfa6052-4941-4f6e-b880-5569fc2da347 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1731 microversion: 2.20 time: 0.171326 Sep 25 04:46:41.261225 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 562/1056] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:46:41 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 04:46:42.287710 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-9741954a-1767-4e2f-923c-fdc5567b0c0e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:42.288403 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-9741954a-1767-4e2f-923c-fdc5567b0c0e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:42.294550 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9741954a-1767-4e2f-923c-fdc5567b0c0e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:42.295001 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9741954a-1767-4e2f-923c-fdc5567b0c0e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:42.295443 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9741954a-1767-4e2f-923c-fdc5567b0c0e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:42.296168 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9741954a-1767-4e2f-923c-fdc5567b0c0e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:42.296631 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9741954a-1767-4e2f-923c-fdc5567b0c0e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:42.297087 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9741954a-1767-4e2f-923c-fdc5567b0c0e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:42.437748 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-9741954a-1767-4e2f-923c-fdc5567b0c0e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:42.440081 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=1 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:46:42.448117 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-9741954a-1767-4e2f-923c-fdc5567b0c0e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:42.449579 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-9741954a-1767-4e2f-923c-fdc5567b0c0e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:42.450728 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-9741954a-1767-4e2f-923c-fdc5567b0c0e tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1731 microversion: 2.20 time: 0.168010 Sep 25 04:46:42.451826 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 495/1057] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:46:42 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:46:42.813192 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-28ae9f65-dd31-41ea-8d40-42803d32ed68 req-7e2e164f-957e-46ba-97a9-6cd377c6603f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ae04d96-b4dc-4acf-9f79-4f6644c1a082", "name": "network-vif-plugged", "status": "completed", "tag": "67e59d38-b12f-4f51-bb79-591d93062336"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:46:42.824296 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-28ae9f65-dd31-41ea-8d40-42803d32ed68 req-7e2e164f-957e-46ba-97a9-6cd377c6603f service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:42.824807 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-28ae9f65-dd31-41ea-8d40-42803d32ed68 req-7e2e164f-957e-46ba-97a9-6cd377c6603f service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:42.825241 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-28ae9f65-dd31-41ea-8d40-42803d32ed68 req-7e2e164f-957e-46ba-97a9-6cd377c6603f service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:42.837445 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-28ae9f65-dd31-41ea-8d40-42803d32ed68 req-7e2e164f-957e-46ba-97a9-6cd377c6603f service nova] Creating event network-vif-plugged:67e59d38-b12f-4f51-bb79-591d93062336 for instance 8ae04d96-b4dc-4acf-9f79-4f6644c1a082 on hv-cinder-85535 Sep 25 04:46:42.842947 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-28ae9f65-dd31-41ea-8d40-42803d32ed68 req-7e2e164f-957e-46ba-97a9-6cd377c6603f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034946 Sep 25 04:46:42.843701 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 563/1058] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:46:43.399859 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-56381824-87ef-4549-92f6-a523a1ae9a30 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:43.400375 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-56381824-87ef-4549-92f6-a523a1ae9a30 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: ffac6eac-431f-426a-9819-d3a16eebbd6e] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:43.407592 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-56381824-87ef-4549-92f6-a523a1ae9a30 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:43.408343 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-56381824-87ef-4549-92f6-a523a1ae9a30 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:43.408881 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-56381824-87ef-4549-92f6-a523a1ae9a30 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:43.409574 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-56381824-87ef-4549-92f6-a523a1ae9a30 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:43.410028 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-56381824-87ef-4549-92f6-a523a1ae9a30 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:43.410453 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-56381824-87ef-4549-92f6-a523a1ae9a30 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:43.441986 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-56381824-87ef-4549-92f6-a523a1ae9a30 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e/os-volume_attachments/c63f4a20-dbfe-4984-bf88-367e2e2d2a4e" status: 200 len: 194 microversion: 2.1 time: 0.046135 Sep 25 04:46:43.442616 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 496/1059] 10.222.0.25 () {58 vars in 1413 bytes} [Sun Sep 25 04:46:43 2022] GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e/os-volume_attachments/c63f4a20-dbfe-4984-bf88-367e2e2d2a4e => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 04:46:43.454734 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-967b5a03-a518-40df-9a01-0b4b9d6e9e78 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:43.455311 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-967b5a03-a518-40df-9a01-0b4b9d6e9e78 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: ffac6eac-431f-426a-9819-d3a16eebbd6e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:43.462041 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-967b5a03-a518-40df-9a01-0b4b9d6e9e78 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:43.462533 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-967b5a03-a518-40df-9a01-0b4b9d6e9e78 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:43.462968 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-967b5a03-a518-40df-9a01-0b4b9d6e9e78 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:43.463682 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-967b5a03-a518-40df-9a01-0b4b9d6e9e78 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:43.464134 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-967b5a03-a518-40df-9a01-0b4b9d6e9e78 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:43.465194 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-967b5a03-a518-40df-9a01-0b4b9d6e9e78 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:43.478609 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-4c6dd28c-2f4a-494b-94e1-02b95dda9ea7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:43.479651 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-4c6dd28c-2f4a-494b-94e1-02b95dda9ea7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:43.489354 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4c6dd28c-2f4a-494b-94e1-02b95dda9ea7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:43.490040 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4c6dd28c-2f4a-494b-94e1-02b95dda9ea7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:43.490683 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4c6dd28c-2f4a-494b-94e1-02b95dda9ea7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:43.491411 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4c6dd28c-2f4a-494b-94e1-02b95dda9ea7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:43.491911 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4c6dd28c-2f4a-494b-94e1-02b95dda9ea7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:43.492352 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4c6dd28c-2f4a-494b-94e1-02b95dda9ea7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:43.559813 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.objects.instance [None req-967b5a03-a518-40df-9a01-0b4b9d6e9e78 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lazy-loading 'services' on Instance uuid ffac6eac-431f-426a-9819-d3a16eebbd6e {{(pid=127142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 04:46:43.643688 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-967b5a03-a518-40df-9a01-0b4b9d6e9e78 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e/os-volume_attachments/c63f4a20-dbfe-4984-bf88-367e2e2d2a4e" status: 202 len: 0 microversion: 2.1 time: 0.193682 Sep 25 04:46:43.646801 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-4c6dd28c-2f4a-494b-94e1-02b95dda9ea7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:43.652860 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 564/1060] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Sep 25 04:46:43 2022] DELETE /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e/os-volume_attachments/c63f4a20-dbfe-4984-bf88-367e2e2d2a4e => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 04:46:43.658939 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-4c6dd28c-2f4a-494b-94e1-02b95dda9ea7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:43.660409 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-4c6dd28c-2f4a-494b-94e1-02b95dda9ea7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:43.661727 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-4c6dd28c-2f4a-494b-94e1-02b95dda9ea7 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1731 microversion: 2.20 time: 0.187721 Sep 25 04:46:43.669027 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 497/1061] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:46:43 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1731 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 04:46:44.691247 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-63858836-e03c-4b08-aba4-113cb4059814 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:44.691943 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-63858836-e03c-4b08-aba4-113cb4059814 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:44.698209 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-63858836-e03c-4b08-aba4-113cb4059814 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:44.698688 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-63858836-e03c-4b08-aba4-113cb4059814 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:44.699125 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-63858836-e03c-4b08-aba4-113cb4059814 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:44.699808 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-63858836-e03c-4b08-aba4-113cb4059814 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:44.700260 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-63858836-e03c-4b08-aba4-113cb4059814 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:44.700706 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-63858836-e03c-4b08-aba4-113cb4059814 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:44.703318 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=1 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:46:44.832607 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-63858836-e03c-4b08-aba4-113cb4059814 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:44.841043 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-63858836-e03c-4b08-aba4-113cb4059814 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:44.842988 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-63858836-e03c-4b08-aba4-113cb4059814 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:44.844365 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-63858836-e03c-4b08-aba4-113cb4059814 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1731 microversion: 2.20 time: 0.157816 Sep 25 04:46:44.844957 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 565/1062] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:46:44 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 04:46:45.870222 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-1489f985-c630-4919-8406-76e4a2f0a0c0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:45.871197 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-1489f985-c630-4919-8406-76e4a2f0a0c0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:45.878196 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1489f985-c630-4919-8406-76e4a2f0a0c0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:45.878687 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1489f985-c630-4919-8406-76e4a2f0a0c0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:45.879131 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1489f985-c630-4919-8406-76e4a2f0a0c0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:45.879830 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1489f985-c630-4919-8406-76e4a2f0a0c0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:45.880287 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1489f985-c630-4919-8406-76e4a2f0a0c0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:45.880868 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1489f985-c630-4919-8406-76e4a2f0a0c0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:46.027033 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-1489f985-c630-4919-8406-76e4a2f0a0c0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:46.035799 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-1489f985-c630-4919-8406-76e4a2f0a0c0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:46.037295 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-1489f985-c630-4919-8406-76e4a2f0a0c0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:46.038469 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-1489f985-c630-4919-8406-76e4a2f0a0c0 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1731 microversion: 2.20 time: 0.172203 Sep 25 04:46:46.039198 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 498/1063] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:46:45 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:46:46.949627 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-180aed84-5cbf-4945-ac25-30ad38d4e7af tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:46.952000 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-180aed84-5cbf-4945-ac25-30ad38d4e7af tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: ffac6eac-431f-426a-9819-d3a16eebbd6e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:46.958730 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-180aed84-5cbf-4945-ac25-30ad38d4e7af tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:46.959208 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-180aed84-5cbf-4945-ac25-30ad38d4e7af tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:46.959639 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-180aed84-5cbf-4945-ac25-30ad38d4e7af tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:46.960317 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-180aed84-5cbf-4945-ac25-30ad38d4e7af tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:46.960795 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-180aed84-5cbf-4945-ac25-30ad38d4e7af tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:46.961213 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-180aed84-5cbf-4945-ac25-30ad38d4e7af tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:46.991311 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-180aed84-5cbf-4945-ac25-30ad38d4e7af tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045672 Sep 25 04:46:46.991848 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 566/1064] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 25 04:46:46 2022] GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 04:46:47.066999 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-6691add2-ebcb-4e84-a17c-3754286443ba tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:47.067757 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-6691add2-ebcb-4e84-a17c-3754286443ba tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:47.074402 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6691add2-ebcb-4e84-a17c-3754286443ba tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:47.074978 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6691add2-ebcb-4e84-a17c-3754286443ba tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:47.075419 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6691add2-ebcb-4e84-a17c-3754286443ba tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:47.076115 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6691add2-ebcb-4e84-a17c-3754286443ba tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:47.076571 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6691add2-ebcb-4e84-a17c-3754286443ba tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:47.077037 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6691add2-ebcb-4e84-a17c-3754286443ba tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:47.109522 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-85fcad92-51f3-4d0b-b0f4-152a63589bec tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:47.111781 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-85fcad92-51f3-4d0b-b0f4-152a63589bec tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: ffac6eac-431f-426a-9819-d3a16eebbd6e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:47.117750 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-85fcad92-51f3-4d0b-b0f4-152a63589bec tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:47.118244 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-85fcad92-51f3-4d0b-b0f4-152a63589bec tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:47.118682 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-85fcad92-51f3-4d0b-b0f4-152a63589bec tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:47.119375 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-85fcad92-51f3-4d0b-b0f4-152a63589bec tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:47.119830 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-85fcad92-51f3-4d0b-b0f4-152a63589bec tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:47.120254 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-85fcad92-51f3-4d0b-b0f4-152a63589bec tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:47.150785 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-85fcad92-51f3-4d0b-b0f4-152a63589bec tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046024 Sep 25 04:46:47.151344 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 567/1065] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 25 04:46:47 2022] GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 25 04:46:47.213854 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-6691add2-ebcb-4e84-a17c-3754286443ba tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:47.216925 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-b6c2ed0c-a55b-4a89-9b51-a114c5c76ab1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:47.217455 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-b6c2ed0c-a55b-4a89-9b51-a114c5c76ab1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: ffac6eac-431f-426a-9819-d3a16eebbd6e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:47.224126 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b6c2ed0c-a55b-4a89-9b51-a114c5c76ab1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:47.224607 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b6c2ed0c-a55b-4a89-9b51-a114c5c76ab1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:47.224747 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-6691add2-ebcb-4e84-a17c-3754286443ba tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:47.225092 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b6c2ed0c-a55b-4a89-9b51-a114c5c76ab1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:47.225776 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b6c2ed0c-a55b-4a89-9b51-a114c5c76ab1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:47.226236 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b6c2ed0c-a55b-4a89-9b51-a114c5c76ab1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:47.226385 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-6691add2-ebcb-4e84-a17c-3754286443ba tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:47.226654 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b6c2ed0c-a55b-4a89-9b51-a114c5c76ab1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:47.228123 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-6691add2-ebcb-4e84-a17c-3754286443ba tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1718 microversion: 2.20 time: 0.164856 Sep 25 04:46:47.228915 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 499/1066] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:46:47 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1718 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:46:47.253640 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-b6c2ed0c-a55b-4a89-9b51-a114c5c76ab1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: ffac6eac-431f-426a-9819-d3a16eebbd6e] Going to try to terminate instance {{(pid=127142) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 04:46:47.328232 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-b6c2ed0c-a55b-4a89-9b51-a114c5c76ab1 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e" status: 204 len: 0 microversion: 2.1 time: 0.114252 Sep 25 04:46:47.329110 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 568/1067] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 25 04:46:47 2022] DELETE /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 25 04:46:47.337506 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-666cca76-7f16-4d27-94bf-6710704dcb0e tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:47.338115 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-666cca76-7f16-4d27-94bf-6710704dcb0e tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: ffac6eac-431f-426a-9819-d3a16eebbd6e] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:47.344421 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-666cca76-7f16-4d27-94bf-6710704dcb0e tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:47.344942 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-666cca76-7f16-4d27-94bf-6710704dcb0e tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:47.345386 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-666cca76-7f16-4d27-94bf-6710704dcb0e tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:47.346074 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-666cca76-7f16-4d27-94bf-6710704dcb0e tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:47.346532 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-666cca76-7f16-4d27-94bf-6710704dcb0e tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:47.346962 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-666cca76-7f16-4d27-94bf-6710704dcb0e tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:47.474593 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-666cca76-7f16-4d27-94bf-6710704dcb0e tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:47.482503 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-666cca76-7f16-4d27-94bf-6710704dcb0e tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e" status: 200 len: 1669 microversion: 2.1 time: 0.148899 Sep 25 04:46:47.483073 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 500/1068] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:46:47 2022] GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e => generated 1669 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:46:48.507938 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-c2b9fb3f-37ec-41df-ad0a-82906ae88832 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:48.508656 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-c2b9fb3f-37ec-41df-ad0a-82906ae88832 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: ffac6eac-431f-426a-9819-d3a16eebbd6e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:48.515556 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c2b9fb3f-37ec-41df-ad0a-82906ae88832 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:48.516038 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c2b9fb3f-37ec-41df-ad0a-82906ae88832 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:48.516471 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c2b9fb3f-37ec-41df-ad0a-82906ae88832 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:48.517194 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c2b9fb3f-37ec-41df-ad0a-82906ae88832 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:48.517644 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c2b9fb3f-37ec-41df-ad0a-82906ae88832 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:48.518066 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c2b9fb3f-37ec-41df-ad0a-82906ae88832 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:48.650839 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-c2b9fb3f-37ec-41df-ad0a-82906ae88832 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:48.659435 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-c2b9fb3f-37ec-41df-ad0a-82906ae88832 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e" status: 200 len: 1669 microversion: 2.1 time: 0.155710 Sep 25 04:46:48.659995 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 569/1069] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:46:48 2022] GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:46:49.683224 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-87119906-c630-4ffb-8c8f-aa07a21d7dfc tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:49.683836 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-87119906-c630-4ffb-8c8f-aa07a21d7dfc tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: ffac6eac-431f-426a-9819-d3a16eebbd6e] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:49.690741 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-87119906-c630-4ffb-8c8f-aa07a21d7dfc tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:49.691232 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-87119906-c630-4ffb-8c8f-aa07a21d7dfc tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:49.691668 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-87119906-c630-4ffb-8c8f-aa07a21d7dfc tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:49.692358 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-87119906-c630-4ffb-8c8f-aa07a21d7dfc tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:49.692854 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-87119906-c630-4ffb-8c8f-aa07a21d7dfc tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:49.693326 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-87119906-c630-4ffb-8c8f-aa07a21d7dfc tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:49.895408 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-87119906-c630-4ffb-8c8f-aa07a21d7dfc tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:49.903342 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-87119906-c630-4ffb-8c8f-aa07a21d7dfc tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e" status: 200 len: 1669 microversion: 2.1 time: 0.224210 Sep 25 04:46:49.903918 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 501/1070] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:46:49 2022] GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e => generated 1669 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:46:50.895522 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-831adabe-47c3-496c-adf7-87fb46e7fa20 req-f99a9c2f-5cb7-4eaf-8199-d8b9233d7318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffac6eac-431f-426a-9819-d3a16eebbd6e", "name": "network-vif-deleted", "tag": "fe1a7c5e-cb1e-42df-9efe-1f8099bbc117"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:46:50.911686 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-831adabe-47c3-496c-adf7-87fb46e7fa20 req-f99a9c2f-5cb7-4eaf-8199-d8b9233d7318 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:50.912239 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-831adabe-47c3-496c-adf7-87fb46e7fa20 req-f99a9c2f-5cb7-4eaf-8199-d8b9233d7318 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:50.912765 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-831adabe-47c3-496c-adf7-87fb46e7fa20 req-f99a9c2f-5cb7-4eaf-8199-d8b9233d7318 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:50.929620 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-0c8b2b91-a231-4640-9f2d-eb0859724e54 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:50.931475 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-0c8b2b91-a231-4640-9f2d-eb0859724e54 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: ffac6eac-431f-426a-9819-d3a16eebbd6e] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:50.940991 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-831adabe-47c3-496c-adf7-87fb46e7fa20 req-f99a9c2f-5cb7-4eaf-8199-d8b9233d7318 service nova] Creating event network-vif-deleted:fe1a7c5e-cb1e-42df-9efe-1f8099bbc117 for instance ffac6eac-431f-426a-9819-d3a16eebbd6e on hv-cinder-85535 Sep 25 04:46:50.943119 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0c8b2b91-a231-4640-9f2d-eb0859724e54 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:50.943782 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0c8b2b91-a231-4640-9f2d-eb0859724e54 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:50.944590 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0c8b2b91-a231-4640-9f2d-eb0859724e54 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:50.945442 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0c8b2b91-a231-4640-9f2d-eb0859724e54 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:50.946061 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0c8b2b91-a231-4640-9f2d-eb0859724e54 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:50.946745 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0c8b2b91-a231-4640-9f2d-eb0859724e54 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:50.951757 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-831adabe-47c3-496c-adf7-87fb46e7fa20 req-f99a9c2f-5cb7-4eaf-8199-d8b9233d7318 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.253945 Sep 25 04:46:50.954341 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 570/1071] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:46:51.005288 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0c8b2b91-a231-4640-9f2d-eb0859724e54 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:51.006071 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0c8b2b91-a231-4640-9f2d-eb0859724e54 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:51.006601 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0c8b2b91-a231-4640-9f2d-eb0859724e54 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:51.007114 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.objects.instance [None req-0c8b2b91-a231-4640-9f2d-eb0859724e54 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lazy-loading 'fault' on Instance uuid ffac6eac-431f-426a-9819-d3a16eebbd6e {{(pid=127141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 04:46:51.056363 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-0c8b2b91-a231-4640-9f2d-eb0859724e54 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16281c79f73e4063b52066966c393148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1108f4c9da246cb9b4b9f89833ceeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:46:51.064948 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-0c8b2b91-a231-4640-9f2d-eb0859724e54 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e" status: 200 len: 1324 microversion: 2.1 time: 0.141134 Sep 25 04:46:51.065514 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 502/1072] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:46:50 2022] GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e => generated 1324 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:46:52.090233 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-ae182e53-9aed-4f19-9c72-2b060f1992ad tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:52.090840 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-ae182e53-9aed-4f19-9c72-2b060f1992ad tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: ffac6eac-431f-426a-9819-d3a16eebbd6e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:52.098008 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ae182e53-9aed-4f19-9c72-2b060f1992ad tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:52.098488 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ae182e53-9aed-4f19-9c72-2b060f1992ad tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:52.098922 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ae182e53-9aed-4f19-9c72-2b060f1992ad tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:52.099603 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ae182e53-9aed-4f19-9c72-2b060f1992ad tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:52.100052 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ae182e53-9aed-4f19-9c72-2b060f1992ad tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:52.100469 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ae182e53-9aed-4f19-9c72-2b060f1992ad tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:52.113825 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.wsgi [None req-ae182e53-9aed-4f19-9c72-2b060f1992ad tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] HTTP exception thrown: Instance ffac6eac-431f-426a-9819-d3a16eebbd6e could not be found. Sep 25 04:46:52.115417 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-ae182e53-9aed-4f19-9c72-2b060f1992ad tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Request method failure captured: Sep 25 04:46:52.115417 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: request: GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e HTTP/1.1 Sep 25 04:46:52.115417 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept: application/json Sep 25 04:46:52.115417 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept-Encoding: identity Sep 25 04:46:52.115417 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Connection: close Sep 25 04:46:52.115417 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Length: 0 Sep 25 04:46:52.115417 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Type: application/json Sep 25 04:46:52.115417 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Host: 10.222.0.25 Sep 25 04:46:52.115417 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Openstack-System-Scope: None Sep 25 04:46:52.115417 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: User-Agent: python-urllib3/1.26.12 Sep 25 04:46:52.115417 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Auth-Token: gAAAAABjL9q7nf9z2AFWe_ZgBI9mzyxKi9FQqxumLn_xkX7-z7097abKZiB6SImy18K0VlZ6olkfGKNBx4S9VI7zNycXzxmkqoBg9SNojmCvkHbKCOn_KIkKAO9bMxiOq-1e9h_jM3ys4d9tw8bBJ8QetDHGpwZpsoOArig8XdzsteOkdzoX_JQ Sep 25 04:46:52.115417 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Id: None Sep 25 04:46:52.115417 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Name: None Sep 25 04:46:52.115417 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Identity-Status: Confirmed Sep 25 04:46:52.115417 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Is-Admin-Project: True Sep 25 04:46:52.115417 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Id: default Sep 25 04:46:52.115417 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Name: Default Sep 25 04:46:52.115417 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Id: e1108f4c9da246cb9b4b9f89833ceeda Sep 25 04:46:52.115417 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Name: tempest-AttachVolumeTestJSON-580125413 Sep 25 04:46:52.115417 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Role: reader,member Sep 25 04:46:52.115417 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Roles: reader,member Sep 25 04:46:52.117134 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e1108f4c9da246cb9b4b9f89833ceeda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e1108f4c9da246cb9b4b9f89833ceeda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e1108f4c9da246cb9b4b9f89833ceeda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e1108f4c9da246cb9b4b9f89833ceeda"}]}] Sep 25 04:46:52.117134 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant: tempest-AttachVolumeTestJSON-580125413 Sep 25 04:46:52.117134 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Id: e1108f4c9da246cb9b4b9f89833ceeda Sep 25 04:46:52.117134 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Name: tempest-AttachVolumeTestJSON-580125413 Sep 25 04:46:52.117134 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User: tempest-AttachVolumeTestJSON-580125413-project Sep 25 04:46:52.117134 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Id: default Sep 25 04:46:52.117134 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Name: Default Sep 25 04:46:52.117134 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Id: 16281c79f73e4063b52066966c393148 Sep 25 04:46:52.117134 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Name: tempest-AttachVolumeTestJSON-580125413-project Sep 25 04:46:52.117134 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: method: > Sep 25 04:46:52.117134 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: exception: Instance ffac6eac-431f-426a-9819-d3a16eebbd6e could not be found. Sep 25 04:46:52.117134 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: action_args: {'id': 'ffac6eac-431f-426a-9819-d3a16eebbd6e'} Sep 25 04:46:52.118102 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:46:52.118102 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:46:52.118102 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:46:52.118102 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:46:52.118102 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:46:52.118102 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:46:52.118102 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:46:52.118102 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:46:52.118102 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:46:52.118102 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:46:52.118102 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffac6eac-431f-426a-9819-d3a16eebbd6e could not be found. Sep 25 04:46:52.118102 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:46:52.118102 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:46:52.118102 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:46:52.118102 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:46:52.118102 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:46:52.118102 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:46:52.118102 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:46:52.118102 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:46:52.118102 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:46:52.119784 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:46:52.119784 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 04:46:52.119784 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 04:46:52.119784 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:46:52.119784 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:46:52.119784 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:46:52.119784 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:46:52.119784 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffac6eac-431f-426a-9819-d3a16eebbd6e could not be found. Sep 25 04:46:52.119784 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:46:52.119784 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:46:52.119784 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:46:52.119784 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:46:52.119784 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:46:52.119784 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:46:52.119784 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:46:52.119784 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:46:52.119784 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffac6eac-431f-426a-9819-d3a16eebbd6e could not be found. Sep 25 04:46:52.119784 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:46:52.121219 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-ae182e53-9aed-4f19-9c72-2b060f1992ad tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Returning 404 to user: Instance ffac6eac-431f-426a-9819-d3a16eebbd6e could not be found. {{(pid=127142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:46:52.121219 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-ae182e53-9aed-4f19-9c72-2b060f1992ad tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e" status: 404 len: 111 microversion: 2.1 time: 0.031747 Sep 25 04:46:52.121219 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 571/1073] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:46:52 2022] GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 04:46:52.125638 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-887a9577-ab6d-4ab5-a0c9-42cded4ff38a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '.version_select at 0x7f4d3ee1e310>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:52.144043 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-887a9577-ab6d-4ab5-a0c9-42cded4ff38a tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-33596097" status: 202 len: 0 microversion: 2.1 time: 0.022249 Sep 25 04:46:52.144591 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 503/1074] 10.222.0.25 () {58 vars in 1215 bytes} [Sun Sep 25 04:46:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-33596097 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 04:46:55.018917 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-08f14a76-fbeb-4818-961b-67a86b02cb9d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:55.019417 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-08f14a76-fbeb-4818-961b-67a86b02cb9d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: ffac6eac-431f-426a-9819-d3a16eebbd6e] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:55.025853 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-08f14a76-fbeb-4818-961b-67a86b02cb9d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:55.026339 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-08f14a76-fbeb-4818-961b-67a86b02cb9d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:55.026771 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-08f14a76-fbeb-4818-961b-67a86b02cb9d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:55.027452 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-08f14a76-fbeb-4818-961b-67a86b02cb9d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:55.027905 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-08f14a76-fbeb-4818-961b-67a86b02cb9d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:55.028330 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-08f14a76-fbeb-4818-961b-67a86b02cb9d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:55.042263 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.wsgi [None req-08f14a76-fbeb-4818-961b-67a86b02cb9d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] HTTP exception thrown: Instance ffac6eac-431f-426a-9819-d3a16eebbd6e could not be found. Sep 25 04:46:55.043780 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-08f14a76-fbeb-4818-961b-67a86b02cb9d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Request method failure captured: Sep 25 04:46:55.043780 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: request: DELETE /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e HTTP/1.1 Sep 25 04:46:55.043780 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept: application/json Sep 25 04:46:55.043780 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept-Encoding: identity Sep 25 04:46:55.043780 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Connection: close Sep 25 04:46:55.043780 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Length: 0 Sep 25 04:46:55.043780 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Type: application/json Sep 25 04:46:55.043780 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Host: 10.222.0.25 Sep 25 04:46:55.043780 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Openstack-System-Scope: None Sep 25 04:46:55.043780 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: User-Agent: python-urllib3/1.26.12 Sep 25 04:46:55.043780 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Auth-Token: gAAAAABjL9q7nf9z2AFWe_ZgBI9mzyxKi9FQqxumLn_xkX7-z7097abKZiB6SImy18K0VlZ6olkfGKNBx4S9VI7zNycXzxmkqoBg9SNojmCvkHbKCOn_KIkKAO9bMxiOq-1e9h_jM3ys4d9tw8bBJ8QetDHGpwZpsoOArig8XdzsteOkdzoX_JQ Sep 25 04:46:55.043780 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Id: None Sep 25 04:46:55.043780 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Name: None Sep 25 04:46:55.043780 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Identity-Status: Confirmed Sep 25 04:46:55.043780 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Is-Admin-Project: True Sep 25 04:46:55.043780 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Id: default Sep 25 04:46:55.043780 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Name: Default Sep 25 04:46:55.043780 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Id: e1108f4c9da246cb9b4b9f89833ceeda Sep 25 04:46:55.043780 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Name: tempest-AttachVolumeTestJSON-580125413 Sep 25 04:46:55.043780 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Role: reader,member Sep 25 04:46:55.043780 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Roles: reader,member Sep 25 04:46:55.045512 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e1108f4c9da246cb9b4b9f89833ceeda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e1108f4c9da246cb9b4b9f89833ceeda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e1108f4c9da246cb9b4b9f89833ceeda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e1108f4c9da246cb9b4b9f89833ceeda"}]}] Sep 25 04:46:55.045512 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant: tempest-AttachVolumeTestJSON-580125413 Sep 25 04:46:55.045512 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Id: e1108f4c9da246cb9b4b9f89833ceeda Sep 25 04:46:55.045512 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Name: tempest-AttachVolumeTestJSON-580125413 Sep 25 04:46:55.045512 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User: tempest-AttachVolumeTestJSON-580125413-project Sep 25 04:46:55.045512 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Id: default Sep 25 04:46:55.045512 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Name: Default Sep 25 04:46:55.045512 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Id: 16281c79f73e4063b52066966c393148 Sep 25 04:46:55.045512 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Name: tempest-AttachVolumeTestJSON-580125413-project Sep 25 04:46:55.045512 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: method: > Sep 25 04:46:55.045512 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: exception: Instance ffac6eac-431f-426a-9819-d3a16eebbd6e could not be found. Sep 25 04:46:55.045512 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: action_args: {'id': 'ffac6eac-431f-426a-9819-d3a16eebbd6e'} Sep 25 04:46:55.046531 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:46:55.046531 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:46:55.046531 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:46:55.046531 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:46:55.046531 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:46:55.046531 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:46:55.046531 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:46:55.046531 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:46:55.046531 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:46:55.046531 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:46:55.046531 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffac6eac-431f-426a-9819-d3a16eebbd6e could not be found. Sep 25 04:46:55.046531 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:46:55.046531 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:46:55.046531 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:46:55.046531 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:46:55.046531 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:46:55.046531 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:46:55.046531 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:46:55.046531 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:46:55.046531 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:46:55.048109 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:46:55.048109 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 04:46:55.048109 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 04:46:55.048109 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 04:46:55.048109 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 04:46:55.048109 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:46:55.048109 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:46:55.048109 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:46:55.048109 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:46:55.048109 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffac6eac-431f-426a-9819-d3a16eebbd6e could not be found. Sep 25 04:46:55.048109 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:46:55.048109 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:46:55.048109 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:46:55.048109 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:46:55.048109 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:46:55.048109 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:46:55.048109 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:46:55.048109 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:46:55.048109 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffac6eac-431f-426a-9819-d3a16eebbd6e could not be found. Sep 25 04:46:55.048109 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:46:55.049829 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-08f14a76-fbeb-4818-961b-67a86b02cb9d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Returning 404 to user: Instance ffac6eac-431f-426a-9819-d3a16eebbd6e could not be found. {{(pid=127142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:46:55.049829 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-08f14a76-fbeb-4818-961b-67a86b02cb9d tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e" status: 404 len: 111 microversion: 2.1 time: 0.030636 Sep 25 04:46:55.049829 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 572/1075] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 25 04:46:55 2022] DELETE /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 04:46:55.054571 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-7b714f2c-4f99-44e9-8f17-68b0372c4bc7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:55.055188 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-7b714f2c-4f99-44e9-8f17-68b0372c4bc7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: ffac6eac-431f-426a-9819-d3a16eebbd6e] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:55.061737 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7b714f2c-4f99-44e9-8f17-68b0372c4bc7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:55.062221 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7b714f2c-4f99-44e9-8f17-68b0372c4bc7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:55.062656 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7b714f2c-4f99-44e9-8f17-68b0372c4bc7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:55.063346 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7b714f2c-4f99-44e9-8f17-68b0372c4bc7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:55.063799 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7b714f2c-4f99-44e9-8f17-68b0372c4bc7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:55.064227 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7b714f2c-4f99-44e9-8f17-68b0372c4bc7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:55.077107 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.wsgi [None req-7b714f2c-4f99-44e9-8f17-68b0372c4bc7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] HTTP exception thrown: Instance ffac6eac-431f-426a-9819-d3a16eebbd6e could not be found. Sep 25 04:46:55.079236 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-7b714f2c-4f99-44e9-8f17-68b0372c4bc7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Request method failure captured: Sep 25 04:46:55.079236 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: request: GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e HTTP/1.1 Sep 25 04:46:55.079236 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept: application/json Sep 25 04:46:55.079236 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept-Encoding: identity Sep 25 04:46:55.079236 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Connection: close Sep 25 04:46:55.079236 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Length: 0 Sep 25 04:46:55.079236 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Type: application/json Sep 25 04:46:55.079236 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Host: 10.222.0.25 Sep 25 04:46:55.079236 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Openstack-System-Scope: None Sep 25 04:46:55.079236 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: User-Agent: python-urllib3/1.26.12 Sep 25 04:46:55.079236 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Auth-Token: gAAAAABjL9q7nf9z2AFWe_ZgBI9mzyxKi9FQqxumLn_xkX7-z7097abKZiB6SImy18K0VlZ6olkfGKNBx4S9VI7zNycXzxmkqoBg9SNojmCvkHbKCOn_KIkKAO9bMxiOq-1e9h_jM3ys4d9tw8bBJ8QetDHGpwZpsoOArig8XdzsteOkdzoX_JQ Sep 25 04:46:55.079236 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Id: None Sep 25 04:46:55.079236 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Name: None Sep 25 04:46:55.079236 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Identity-Status: Confirmed Sep 25 04:46:55.079236 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Is-Admin-Project: True Sep 25 04:46:55.079236 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Id: default Sep 25 04:46:55.079236 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Name: Default Sep 25 04:46:55.079236 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Id: e1108f4c9da246cb9b4b9f89833ceeda Sep 25 04:46:55.079236 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Name: tempest-AttachVolumeTestJSON-580125413 Sep 25 04:46:55.079236 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Role: reader,member Sep 25 04:46:55.079236 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Roles: reader,member Sep 25 04:46:55.080873 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e1108f4c9da246cb9b4b9f89833ceeda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e1108f4c9da246cb9b4b9f89833ceeda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e1108f4c9da246cb9b4b9f89833ceeda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e1108f4c9da246cb9b4b9f89833ceeda"}]}] Sep 25 04:46:55.080873 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant: tempest-AttachVolumeTestJSON-580125413 Sep 25 04:46:55.080873 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Id: e1108f4c9da246cb9b4b9f89833ceeda Sep 25 04:46:55.080873 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Name: tempest-AttachVolumeTestJSON-580125413 Sep 25 04:46:55.080873 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User: tempest-AttachVolumeTestJSON-580125413-project Sep 25 04:46:55.080873 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Id: default Sep 25 04:46:55.080873 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Name: Default Sep 25 04:46:55.080873 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Id: 16281c79f73e4063b52066966c393148 Sep 25 04:46:55.080873 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Name: tempest-AttachVolumeTestJSON-580125413-project Sep 25 04:46:55.080873 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: method: > Sep 25 04:46:55.080873 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: exception: Instance ffac6eac-431f-426a-9819-d3a16eebbd6e could not be found. Sep 25 04:46:55.080873 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: action_args: {'id': 'ffac6eac-431f-426a-9819-d3a16eebbd6e'} Sep 25 04:46:55.081716 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:46:55.081716 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:46:55.081716 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:46:55.081716 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:46:55.081716 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:46:55.081716 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:46:55.081716 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:46:55.081716 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:46:55.081716 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:46:55.081716 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:46:55.081716 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffac6eac-431f-426a-9819-d3a16eebbd6e could not be found. Sep 25 04:46:55.081716 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:46:55.081716 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:46:55.081716 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:46:55.081716 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:46:55.081716 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:46:55.081716 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:46:55.081716 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:46:55.081716 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:46:55.081716 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:46:55.082973 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:46:55.082973 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 04:46:55.082973 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 04:46:55.082973 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:46:55.082973 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:46:55.082973 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:46:55.082973 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:46:55.082973 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffac6eac-431f-426a-9819-d3a16eebbd6e could not be found. Sep 25 04:46:55.082973 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:46:55.082973 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:46:55.082973 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:46:55.082973 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:46:55.082973 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:46:55.082973 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:46:55.082973 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:46:55.082973 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:46:55.082973 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffac6eac-431f-426a-9819-d3a16eebbd6e could not be found. Sep 25 04:46:55.082973 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:46:55.084103 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-7b714f2c-4f99-44e9-8f17-68b0372c4bc7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Returning 404 to user: Instance ffac6eac-431f-426a-9819-d3a16eebbd6e could not be found. {{(pid=127141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:46:55.084103 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-7b714f2c-4f99-44e9-8f17-68b0372c4bc7 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e" status: 404 len: 111 microversion: 2.1 time: 0.030505 Sep 25 04:46:55.084103 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 504/1076] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:46:55 2022] GET /compute/v2.1/servers/ffac6eac-431f-426a-9819-d3a16eebbd6e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 04:46:56.224057 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-f0488b82-df80-4608-b377-904fa3956b31 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:56.224578 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-f0488b82-df80-4608-b377-904fa3956b31 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:56.230968 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f0488b82-df80-4608-b377-904fa3956b31 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:56.231453 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f0488b82-df80-4608-b377-904fa3956b31 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:56.231887 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f0488b82-df80-4608-b377-904fa3956b31 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:56.232570 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f0488b82-df80-4608-b377-904fa3956b31 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:56.233065 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f0488b82-df80-4608-b377-904fa3956b31 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:56.233531 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f0488b82-df80-4608-b377-904fa3956b31 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:56.247365 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.wsgi [None req-f0488b82-df80-4608-b377-904fa3956b31 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] HTTP exception thrown: Instance c9be0143-7c91-4fba-8c2c-500f01573632 could not be found. Sep 25 04:46:56.248946 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-f0488b82-df80-4608-b377-904fa3956b31 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Request method failure captured: Sep 25 04:46:56.248946 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: request: DELETE /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 HTTP/1.1 Sep 25 04:46:56.248946 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept: application/json Sep 25 04:46:56.248946 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept-Encoding: identity Sep 25 04:46:56.248946 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Connection: close Sep 25 04:46:56.248946 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Length: 0 Sep 25 04:46:56.248946 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Type: application/json Sep 25 04:46:56.248946 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Host: 10.222.0.25 Sep 25 04:46:56.248946 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Openstack-System-Scope: None Sep 25 04:46:56.248946 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: User-Agent: python-urllib3/1.26.12 Sep 25 04:46:56.248946 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Auth-Token: gAAAAABjL9q7nf9z2AFWe_ZgBI9mzyxKi9FQqxumLn_xkX7-z7097abKZiB6SImy18K0VlZ6olkfGKNBx4S9VI7zNycXzxmkqoBg9SNojmCvkHbKCOn_KIkKAO9bMxiOq-1e9h_jM3ys4d9tw8bBJ8QetDHGpwZpsoOArig8XdzsteOkdzoX_JQ Sep 25 04:46:56.248946 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Id: None Sep 25 04:46:56.248946 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Name: None Sep 25 04:46:56.248946 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Identity-Status: Confirmed Sep 25 04:46:56.248946 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Is-Admin-Project: True Sep 25 04:46:56.248946 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Id: default Sep 25 04:46:56.248946 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Name: Default Sep 25 04:46:56.248946 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Id: e1108f4c9da246cb9b4b9f89833ceeda Sep 25 04:46:56.248946 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Name: tempest-AttachVolumeTestJSON-580125413 Sep 25 04:46:56.248946 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Role: reader,member Sep 25 04:46:56.248946 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Roles: reader,member Sep 25 04:46:56.251264 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e1108f4c9da246cb9b4b9f89833ceeda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e1108f4c9da246cb9b4b9f89833ceeda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e1108f4c9da246cb9b4b9f89833ceeda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e1108f4c9da246cb9b4b9f89833ceeda"}]}] Sep 25 04:46:56.251264 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant: tempest-AttachVolumeTestJSON-580125413 Sep 25 04:46:56.251264 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Id: e1108f4c9da246cb9b4b9f89833ceeda Sep 25 04:46:56.251264 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Name: tempest-AttachVolumeTestJSON-580125413 Sep 25 04:46:56.251264 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User: tempest-AttachVolumeTestJSON-580125413-project Sep 25 04:46:56.251264 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Id: default Sep 25 04:46:56.251264 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Name: Default Sep 25 04:46:56.251264 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Id: 16281c79f73e4063b52066966c393148 Sep 25 04:46:56.251264 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Name: tempest-AttachVolumeTestJSON-580125413-project Sep 25 04:46:56.251264 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: method: > Sep 25 04:46:56.251264 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: exception: Instance c9be0143-7c91-4fba-8c2c-500f01573632 could not be found. Sep 25 04:46:56.251264 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: action_args: {'id': 'c9be0143-7c91-4fba-8c2c-500f01573632'} Sep 25 04:46:56.252114 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:46:56.252114 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:46:56.252114 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:46:56.252114 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:46:56.252114 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:46:56.252114 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:46:56.252114 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:46:56.252114 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:46:56.252114 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:46:56.252114 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:46:56.252114 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9be0143-7c91-4fba-8c2c-500f01573632 could not be found. Sep 25 04:46:56.252114 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:46:56.252114 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:46:56.252114 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:46:56.252114 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:46:56.252114 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:46:56.252114 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:46:56.252114 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:46:56.252114 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:46:56.252114 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:46:56.254317 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:46:56.254317 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 04:46:56.254317 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 04:46:56.254317 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 04:46:56.254317 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 04:46:56.254317 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:46:56.254317 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:46:56.254317 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:46:56.254317 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:46:56.254317 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9be0143-7c91-4fba-8c2c-500f01573632 could not be found. Sep 25 04:46:56.254317 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:46:56.254317 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:46:56.254317 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:46:56.254317 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:46:56.254317 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:46:56.254317 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:46:56.254317 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:46:56.254317 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:46:56.254317 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9be0143-7c91-4fba-8c2c-500f01573632 could not be found. Sep 25 04:46:56.254317 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:46:56.256346 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-f0488b82-df80-4608-b377-904fa3956b31 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Returning 404 to user: Instance c9be0143-7c91-4fba-8c2c-500f01573632 could not be found. {{(pid=127142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:46:56.256346 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-f0488b82-df80-4608-b377-904fa3956b31 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 404 len: 111 microversion: 2.1 time: 0.030977 Sep 25 04:46:56.256346 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 573/1077] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 25 04:46:56 2022] DELETE /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 04:46:56.259590 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-03493d02-31a2-4a3f-b148-eb10c84bede9 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:46:56.260209 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-03493d02-31a2-4a3f-b148-eb10c84bede9 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] [instance: c9be0143-7c91-4fba-8c2c-500f01573632] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:46:56.268122 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-03493d02-31a2-4a3f-b148-eb10c84bede9 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:56.269236 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-03493d02-31a2-4a3f-b148-eb10c84bede9 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:56.269956 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-03493d02-31a2-4a3f-b148-eb10c84bede9 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:56.271080 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-03493d02-31a2-4a3f-b148-eb10c84bede9 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:46:56.271840 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-03493d02-31a2-4a3f-b148-eb10c84bede9 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:46:56.272548 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-03493d02-31a2-4a3f-b148-eb10c84bede9 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:46:56.295097 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.wsgi [None req-03493d02-31a2-4a3f-b148-eb10c84bede9 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] HTTP exception thrown: Instance c9be0143-7c91-4fba-8c2c-500f01573632 could not be found. Sep 25 04:46:56.298549 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-03493d02-31a2-4a3f-b148-eb10c84bede9 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Request method failure captured: Sep 25 04:46:56.298549 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: request: GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 HTTP/1.1 Sep 25 04:46:56.298549 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept: application/json Sep 25 04:46:56.298549 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept-Encoding: identity Sep 25 04:46:56.298549 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Connection: close Sep 25 04:46:56.298549 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Length: 0 Sep 25 04:46:56.298549 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Type: application/json Sep 25 04:46:56.298549 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Host: 10.222.0.25 Sep 25 04:46:56.298549 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Openstack-System-Scope: None Sep 25 04:46:56.298549 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: User-Agent: python-urllib3/1.26.12 Sep 25 04:46:56.298549 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Auth-Token: gAAAAABjL9q7nf9z2AFWe_ZgBI9mzyxKi9FQqxumLn_xkX7-z7097abKZiB6SImy18K0VlZ6olkfGKNBx4S9VI7zNycXzxmkqoBg9SNojmCvkHbKCOn_KIkKAO9bMxiOq-1e9h_jM3ys4d9tw8bBJ8QetDHGpwZpsoOArig8XdzsteOkdzoX_JQ Sep 25 04:46:56.298549 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Id: None Sep 25 04:46:56.298549 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Name: None Sep 25 04:46:56.298549 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Identity-Status: Confirmed Sep 25 04:46:56.298549 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Is-Admin-Project: True Sep 25 04:46:56.298549 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Id: default Sep 25 04:46:56.298549 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Name: Default Sep 25 04:46:56.298549 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Id: e1108f4c9da246cb9b4b9f89833ceeda Sep 25 04:46:56.298549 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Name: tempest-AttachVolumeTestJSON-580125413 Sep 25 04:46:56.298549 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Role: reader,member Sep 25 04:46:56.298549 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Roles: reader,member Sep 25 04:46:56.300079 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e1108f4c9da246cb9b4b9f89833ceeda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e1108f4c9da246cb9b4b9f89833ceeda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e1108f4c9da246cb9b4b9f89833ceeda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e1108f4c9da246cb9b4b9f89833ceeda"}]}] Sep 25 04:46:56.300079 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant: tempest-AttachVolumeTestJSON-580125413 Sep 25 04:46:56.300079 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Id: e1108f4c9da246cb9b4b9f89833ceeda Sep 25 04:46:56.300079 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Name: tempest-AttachVolumeTestJSON-580125413 Sep 25 04:46:56.300079 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User: tempest-AttachVolumeTestJSON-580125413-project Sep 25 04:46:56.300079 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Id: default Sep 25 04:46:56.300079 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Name: Default Sep 25 04:46:56.300079 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Id: 16281c79f73e4063b52066966c393148 Sep 25 04:46:56.300079 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Name: tempest-AttachVolumeTestJSON-580125413-project Sep 25 04:46:56.300079 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: method: > Sep 25 04:46:56.300079 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: exception: Instance c9be0143-7c91-4fba-8c2c-500f01573632 could not be found. Sep 25 04:46:56.300079 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: action_args: {'id': 'c9be0143-7c91-4fba-8c2c-500f01573632'} Sep 25 04:46:56.300917 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:46:56.300917 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:46:56.300917 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:46:56.300917 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:46:56.300917 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:46:56.300917 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:46:56.300917 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:46:56.300917 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:46:56.300917 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:46:56.300917 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:46:56.300917 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9be0143-7c91-4fba-8c2c-500f01573632 could not be found. Sep 25 04:46:56.300917 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:46:56.300917 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:46:56.300917 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:46:56.300917 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:46:56.300917 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:46:56.300917 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:46:56.300917 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:46:56.300917 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:46:56.300917 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:46:56.302358 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:46:56.302358 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 04:46:56.302358 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 04:46:56.302358 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:46:56.302358 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:46:56.302358 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:46:56.302358 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:46:56.302358 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9be0143-7c91-4fba-8c2c-500f01573632 could not be found. Sep 25 04:46:56.302358 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:46:56.302358 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:46:56.302358 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:46:56.302358 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:46:56.302358 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:46:56.302358 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:46:56.302358 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:46:56.302358 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:46:56.302358 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9be0143-7c91-4fba-8c2c-500f01573632 could not be found. Sep 25 04:46:56.302358 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:46:56.303532 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-03493d02-31a2-4a3f-b148-eb10c84bede9 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] Returning 404 to user: Instance c9be0143-7c91-4fba-8c2c-500f01573632 could not be found. {{(pid=127141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:46:56.303532 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-03493d02-31a2-4a3f-b148-eb10c84bede9 tempest-AttachVolumeTestJSON-580125413 tempest-AttachVolumeTestJSON-580125413-project] 10.222.0.25 "GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632" status: 404 len: 111 microversion: 2.1 time: 0.044812 Sep 25 04:46:56.303532 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 505/1078] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:46:56 2022] GET /compute/v2.1/servers/c9be0143-7c91-4fba-8c2c-500f01573632 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 04:47:00.804912 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-f700a793-ee12-4061-98e6-5652f49c9020 tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] Action: 'create', calling method: .version_select at 0x7f4d3eef71f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1143223386"}} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:47:01.104669 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-f700a793-ee12-4061-98e6-5652f49c9020 tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.414244 Sep 25 04:47:01.105343 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 574/1079] 10.222.0.25 () {60 vars in 1155 bytes} [Sun Sep 25 04:47:00 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 416 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 25 04:47:01.118640 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-22ece491-8f53-4351-891a-52b757588f2d tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] Calling method '.version_select at 0x7f4d3eff94c0>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:01.171378 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-22ece491-8f53-4351-891a-52b757588f2d tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/deab3677-af1a-419a-9d9e-8a3410479d3b" status: 200 len: 345 microversion: 2.1 time: 0.056305 Sep 25 04:47:01.172011 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 506/1080] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Sep 25 04:47:01 2022] GET /compute/v2.1/os-volumes/deab3677-af1a-419a-9d9e-8a3410479d3b => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:47:02.186633 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-a359c62f-7422-49cf-b747-c08e3f33c742 tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] Calling method '.version_select at 0x7f4d3ed67ca0>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:02.232389 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-a359c62f-7422-49cf-b747-c08e3f33c742 tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/deab3677-af1a-419a-9d9e-8a3410479d3b" status: 200 len: 346 microversion: 2.1 time: 0.050311 Sep 25 04:47:02.232980 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 575/1081] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Sep 25 04:47:02 2022] GET /compute/v2.1/os-volumes/deab3677-af1a-419a-9d9e-8a3410479d3b => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:47:02.247874 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-bb3de128-7050-45f1-b776-175b43920398 tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] Action: 'create', calling method: .version_select at 0x7f4d3ee2d550>, body: {"snapshot": {"volume_id": "deab3677-af1a-419a-9d9e-8a3410479d3b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2102125492"}} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:47:02.395722 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-bb3de128-7050-45f1-b776-175b43920398 tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] 10.222.0.25 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.152330 Sep 25 04:47:02.396310 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 507/1082] 10.222.0.25 () {60 vars in 1162 bytes} [Sun Sep 25 04:47:02 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:47:02.407933 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-e3419f5d-7f21-4318-8c34-0f9bd59d6622 tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] Calling method '.version_select at 0x7f4d3ed67f70>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:02.438380 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-e3419f5d-7f21-4318-8c34-0f9bd59d6622 tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/8eb1703d-3a6b-46b6-b47b-d0a8708cd337" status: 200 len: 287 microversion: 2.1 time: 0.034785 Sep 25 04:47:02.438890 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 576/1083] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Sep 25 04:47:02 2022] GET /compute/v2.1/os-snapshots/8eb1703d-3a6b-46b6-b47b-d0a8708cd337 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:47:02.449780 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-d59e420e-9500-4c32-a42f-7a83a9b775bf tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] Calling method '.version_select at 0x7f4d3ee1eca0>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:02.483709 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-d59e420e-9500-4c32-a42f-7a83a9b775bf tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.037598 Sep 25 04:47:02.484468 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 508/1084] 10.222.0.25 () {58 vars in 1140 bytes} [Sun Sep 25 04:47:02 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:47:02.495429 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-50174b81-10d1-4358-b98c-3a64eea9a5cd tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] Calling method '.version_select at 0x7f4d3ef2b700>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:02.524620 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-50174b81-10d1-4358-b98c-3a64eea9a5cd tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/8eb1703d-3a6b-46b6-b47b-d0a8708cd337" status: 200 len: 287 microversion: 2.1 time: 0.032918 Sep 25 04:47:02.525232 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 577/1085] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Sep 25 04:47:02 2022] GET /compute/v2.1/os-snapshots/8eb1703d-3a6b-46b6-b47b-d0a8708cd337 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:47:03.537918 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-7a6f26fc-4660-4282-bf23-a32de5642951 tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] Calling method '.version_select at 0x7f4d3ec794c0>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:03.567266 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-7a6f26fc-4660-4282-bf23-a32de5642951 tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/8eb1703d-3a6b-46b6-b47b-d0a8708cd337" status: 200 len: 287 microversion: 2.1 time: 0.033617 Sep 25 04:47:03.567826 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 509/1086] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Sep 25 04:47:03 2022] GET /compute/v2.1/os-snapshots/8eb1703d-3a6b-46b6-b47b-d0a8708cd337 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:47:04.580726 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-ac689738-0367-47f0-bba9-7160330f7e95 tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] Calling method '.version_select at 0x7f4d3eca8a60>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:04.610853 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-ac689738-0367-47f0-bba9-7160330f7e95 tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/8eb1703d-3a6b-46b6-b47b-d0a8708cd337" status: 200 len: 287 microversion: 2.1 time: 0.034716 Sep 25 04:47:04.611431 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 578/1087] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Sep 25 04:47:04 2022] GET /compute/v2.1/os-snapshots/8eb1703d-3a6b-46b6-b47b-d0a8708cd337 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:47:05.624444 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-000c78c8-5f99-4fc7-a095-10e3f78fb186 tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] Calling method '.version_select at 0x7f4d3ed165e0>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:05.653722 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-000c78c8-5f99-4fc7-a095-10e3f78fb186 tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/8eb1703d-3a6b-46b6-b47b-d0a8708cd337" status: 200 len: 287 microversion: 2.1 time: 0.034176 Sep 25 04:47:05.654277 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 510/1088] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Sep 25 04:47:05 2022] GET /compute/v2.1/os-snapshots/8eb1703d-3a6b-46b6-b47b-d0a8708cd337 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:47:06.663325 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:47:06.664105 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:47:06.667957 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-038062f5-4445-4b29-8260-5859d455c865 tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] Calling method '.version_select at 0x7f4d3ed67e50>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:06.698950 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-038062f5-4445-4b29-8260-5859d455c865 tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/8eb1703d-3a6b-46b6-b47b-d0a8708cd337" status: 200 len: 287 microversion: 2.1 time: 0.036847 Sep 25 04:47:06.699515 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 579/1089] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Sep 25 04:47:06 2022] GET /compute/v2.1/os-snapshots/8eb1703d-3a6b-46b6-b47b-d0a8708cd337 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:47:07.708264 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:47:07.709133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=49 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:47:07.713450 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-4978d6f5-c822-4136-957a-7b9585e05c60 tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] Calling method '.version_select at 0x7f4d3edd3160>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:07.743872 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-4978d6f5-c822-4136-957a-7b9585e05c60 tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/8eb1703d-3a6b-46b6-b47b-d0a8708cd337" status: 200 len: 288 microversion: 2.1 time: 0.036245 Sep 25 04:47:07.744459 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 511/1090] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Sep 25 04:47:07 2022] GET /compute/v2.1/os-snapshots/8eb1703d-3a6b-46b6-b47b-d0a8708cd337 => generated 288 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:47:07.756620 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-3b9fecea-ebf0-4db9-97d9-8eac651f2dc8 tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] Calling method '.version_select at 0x7f4d3eef79d0>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:07.813155 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-3b9fecea-ebf0-4db9-97d9-8eac651f2dc8 tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] 10.222.0.25 "DELETE /compute/v2.1/os-snapshots/8eb1703d-3a6b-46b6-b47b-d0a8708cd337" status: 202 len: 0 microversion: 2.1 time: 0.060976 Sep 25 04:47:07.813738 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 580/1091] 10.222.0.25 () {58 vars in 1254 bytes} [Sun Sep 25 04:47:07 2022] DELETE /compute/v2.1/os-snapshots/8eb1703d-3a6b-46b6-b47b-d0a8708cd337 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 04:47:07.821896 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-b695982e-ce97-493e-85d4-d6f3bbb1b98f tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] Calling method '.version_select at 0x7f4d3ecd1c10>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:07.852503 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-b695982e-ce97-493e-85d4-d6f3bbb1b98f tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/8eb1703d-3a6b-46b6-b47b-d0a8708cd337" status: 200 len: 287 microversion: 2.1 time: 0.034446 Sep 25 04:47:07.853094 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 512/1092] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Sep 25 04:47:07 2022] GET /compute/v2.1/os-snapshots/8eb1703d-3a6b-46b6-b47b-d0a8708cd337 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:47:08.866714 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-118ce571-2520-4881-999c-beb929f76810 tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] Calling method '.version_select at 0x7f4d3ef2b0d0>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:08.891099 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.wsgi [None req-118ce571-2520-4881-999c-beb929f76810 tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] HTTP exception thrown: Snapshot 8eb1703d-3a6b-46b6-b47b-d0a8708cd337 could not be found. Sep 25 04:47:08.893517 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-118ce571-2520-4881-999c-beb929f76810 tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] Request method failure captured: Sep 25 04:47:08.893517 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: request: GET /compute/v2.1/os-snapshots/8eb1703d-3a6b-46b6-b47b-d0a8708cd337 HTTP/1.1 Sep 25 04:47:08.893517 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept: application/json Sep 25 04:47:08.893517 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept-Encoding: identity Sep 25 04:47:08.893517 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Connection: close Sep 25 04:47:08.893517 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Length: 0 Sep 25 04:47:08.893517 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Type: application/json Sep 25 04:47:08.893517 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Host: 10.222.0.25 Sep 25 04:47:08.893517 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Openstack-System-Scope: None Sep 25 04:47:08.893517 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: User-Agent: python-urllib3/1.26.12 Sep 25 04:47:08.893517 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Auth-Token: gAAAAABjL91EMQA1o3hSM3tp4BeI3qeXE04_u2T7CoQyz9hY78IxbQT6NTs9RqEan4cdbLsjDwC8BDzexKZJT-X7DJGku2MFQYFcz-c1i726sj5kKN6dUeyjoocmKQdCN9Y7c-UsiE2kH4FCHB1vV6hrVNuVf0KnUBSx8j7VwpXCmtB5e_9YOgY Sep 25 04:47:08.893517 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Id: None Sep 25 04:47:08.893517 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Name: None Sep 25 04:47:08.893517 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Identity-Status: Confirmed Sep 25 04:47:08.893517 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Is-Admin-Project: True Sep 25 04:47:08.893517 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Id: default Sep 25 04:47:08.893517 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Name: Default Sep 25 04:47:08.893517 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Id: 51b6143a4c7549d3b0abfabff6e2dbac Sep 25 04:47:08.893517 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2124145483 Sep 25 04:47:08.893517 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Role: reader,member Sep 25 04:47:08.893517 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Roles: reader,member Sep 25 04:47:08.894913 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/51b6143a4c7549d3b0abfabff6e2dbac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/51b6143a4c7549d3b0abfabff6e2dbac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/51b6143a4c7549d3b0abfabff6e2dbac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_51b6143a4c7549d3b0abfabff6e2dbac"}]}] Sep 25 04:47:08.894913 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2124145483 Sep 25 04:47:08.894913 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Id: 51b6143a4c7549d3b0abfabff6e2dbac Sep 25 04:47:08.894913 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2124145483 Sep 25 04:47:08.894913 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User: tempest-VolumesSnapshotsTestJSON-2124145483-project Sep 25 04:47:08.894913 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Id: default Sep 25 04:47:08.894913 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Name: Default Sep 25 04:47:08.894913 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Id: ae7cd2182632480c832e52790cce7095 Sep 25 04:47:08.894913 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2124145483-project Sep 25 04:47:08.894913 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: method: Sep 25 04:47:08.894913 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: exception: Snapshot 8eb1703d-3a6b-46b6-b47b-d0a8708cd337 could not be found. Sep 25 04:47:08.894913 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: action_args: {'id': '8eb1703d-3a6b-46b6-b47b-d0a8708cd337'} Sep 25 04:47:08.894913 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:47:08.895926 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:08.895926 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 25 04:47:08.895926 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 25 04:47:08.895926 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 25 04:47:08.895926 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 25 04:47:08.895926 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 25 04:47:08.895926 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 25 04:47:08.895926 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 25 04:47:08.895926 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 25 04:47:08.895926 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 25 04:47:08.895926 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 25 04:47:08.895926 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 04:47:08.895926 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 04:47:08.895926 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 04:47:08.895926 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 04:47:08.895926 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 8eb1703d-3a6b-46b6-b47b-d0a8708cd337 could not be found. (HTTP 404) (Request-ID: req-348738bb-3300-4bef-bb5f-2df9836842b6) Sep 25 04:47:08.895926 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:08.895926 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:08.897148 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:08.897148 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:08.897148 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 25 04:47:08.897148 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 25 04:47:08.897148 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 25 04:47:08.897148 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 25 04:47:08.897148 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 25 04:47:08.897148 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 25 04:47:08.897148 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 25 04:47:08.897148 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 25 04:47:08.897148 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 25 04:47:08.897148 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 25 04:47:08.897148 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 25 04:47:08.897148 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 25 04:47:08.897148 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 25 04:47:08.897148 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 25 04:47:08.897148 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 25 04:47:08.897148 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 25 04:47:08.897148 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 25 04:47:08.898373 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 25 04:47:08.898373 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 04:47:08.898373 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 04:47:08.898373 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 04:47:08.898373 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 04:47:08.898373 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 8eb1703d-3a6b-46b6-b47b-d0a8708cd337 could not be found. Sep 25 04:47:08.898373 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:08.898373 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:08.898373 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:08.898373 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:08.898373 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:08.898373 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:08.898373 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:47:08.898373 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:47:08.898373 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 04:47:08.898373 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 04:47:08.898373 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:47:08.898373 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:47:08.898373 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 25 04:47:08.898373 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:47:08.899672 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 8eb1703d-3a6b-46b6-b47b-d0a8708cd337 could not be found. Sep 25 04:47:08.899672 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:08.899672 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:08.899672 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:08.899672 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:08.899672 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:08.899672 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:08.899672 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:47:08.899672 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:47:08.899672 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 8eb1703d-3a6b-46b6-b47b-d0a8708cd337 could not be found. Sep 25 04:47:08.899672 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:08.899672 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-118ce571-2520-4881-999c-beb929f76810 tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] Returning 404 to user: Snapshot 8eb1703d-3a6b-46b6-b47b-d0a8708cd337 could not be found. {{(pid=127142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:47:08.899672 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-118ce571-2520-4881-999c-beb929f76810 tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/8eb1703d-3a6b-46b6-b47b-d0a8708cd337" status: 404 len: 111 microversion: 2.1 time: 0.032647 Sep 25 04:47:08.900509 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 581/1093] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Sep 25 04:47:08 2022] GET /compute/v2.1/os-snapshots/8eb1703d-3a6b-46b6-b47b-d0a8708cd337 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 04:47:08.904111 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-9fed5256-c8ad-4a6d-b121-4f6912055635 tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] Calling method '.version_select at 0x7f4d3ee2df70>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:08.966644 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-9fed5256-c8ad-4a6d-b121-4f6912055635 tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/deab3677-af1a-419a-9d9e-8a3410479d3b" status: 202 len: 0 microversion: 2.1 time: 0.066723 Sep 25 04:47:08.967209 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 513/1094] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Sep 25 04:47:08 2022] DELETE /compute/v2.1/os-volumes/deab3677-af1a-419a-9d9e-8a3410479d3b => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 04:47:08.977731 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-2e12f071-53e8-49e8-94ac-cdea1d429503 tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] Calling method '.version_select at 0x7f4d3ef2b0d0>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:09.025394 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-2e12f071-53e8-49e8-94ac-cdea1d429503 tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/deab3677-af1a-419a-9d9e-8a3410479d3b" status: 200 len: 345 microversion: 2.1 time: 0.052141 Sep 25 04:47:09.026122 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 582/1095] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Sep 25 04:47:08 2022] GET /compute/v2.1/os-volumes/deab3677-af1a-419a-9d9e-8a3410479d3b => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:47:10.042367 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-120dc924-ac55-41df-9117-7eb4f6c85e57 tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] Calling method '.version_select at 0x7f4d3ed16e50>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:10.070675 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.wsgi [None req-120dc924-ac55-41df-9117-7eb4f6c85e57 tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] HTTP exception thrown: Volume deab3677-af1a-419a-9d9e-8a3410479d3b could not be found. Sep 25 04:47:10.073907 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-120dc924-ac55-41df-9117-7eb4f6c85e57 tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] Request method failure captured: Sep 25 04:47:10.073907 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: request: GET /compute/v2.1/os-volumes/deab3677-af1a-419a-9d9e-8a3410479d3b HTTP/1.1 Sep 25 04:47:10.073907 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept: application/json Sep 25 04:47:10.073907 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept-Encoding: identity Sep 25 04:47:10.073907 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Connection: close Sep 25 04:47:10.073907 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Length: 0 Sep 25 04:47:10.073907 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Type: application/json Sep 25 04:47:10.073907 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Host: 10.222.0.25 Sep 25 04:47:10.073907 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Openstack-System-Scope: None Sep 25 04:47:10.073907 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: User-Agent: python-urllib3/1.26.12 Sep 25 04:47:10.073907 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Auth-Token: gAAAAABjL91EMQA1o3hSM3tp4BeI3qeXE04_u2T7CoQyz9hY78IxbQT6NTs9RqEan4cdbLsjDwC8BDzexKZJT-X7DJGku2MFQYFcz-c1i726sj5kKN6dUeyjoocmKQdCN9Y7c-UsiE2kH4FCHB1vV6hrVNuVf0KnUBSx8j7VwpXCmtB5e_9YOgY Sep 25 04:47:10.073907 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Id: None Sep 25 04:47:10.073907 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Name: None Sep 25 04:47:10.073907 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Identity-Status: Confirmed Sep 25 04:47:10.073907 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Is-Admin-Project: True Sep 25 04:47:10.073907 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Id: default Sep 25 04:47:10.073907 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Name: Default Sep 25 04:47:10.073907 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Id: 51b6143a4c7549d3b0abfabff6e2dbac Sep 25 04:47:10.073907 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2124145483 Sep 25 04:47:10.073907 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Role: reader,member Sep 25 04:47:10.073907 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Roles: reader,member Sep 25 04:47:10.075509 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/51b6143a4c7549d3b0abfabff6e2dbac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/51b6143a4c7549d3b0abfabff6e2dbac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/51b6143a4c7549d3b0abfabff6e2dbac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_51b6143a4c7549d3b0abfabff6e2dbac"}]}] Sep 25 04:47:10.075509 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2124145483 Sep 25 04:47:10.075509 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Id: 51b6143a4c7549d3b0abfabff6e2dbac Sep 25 04:47:10.075509 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2124145483 Sep 25 04:47:10.075509 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User: tempest-VolumesSnapshotsTestJSON-2124145483-project Sep 25 04:47:10.075509 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Id: default Sep 25 04:47:10.075509 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Name: Default Sep 25 04:47:10.075509 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Id: ae7cd2182632480c832e52790cce7095 Sep 25 04:47:10.075509 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2124145483-project Sep 25 04:47:10.075509 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: method: Sep 25 04:47:10.075509 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: exception: Volume deab3677-af1a-419a-9d9e-8a3410479d3b could not be found. Sep 25 04:47:10.075509 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: action_args: {'id': 'deab3677-af1a-419a-9d9e-8a3410479d3b'} Sep 25 04:47:10.075509 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:47:10.076568 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:10.076568 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 04:47:10.076568 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 04:47:10.076568 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 25 04:47:10.076568 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 25 04:47:10.076568 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 25 04:47:10.076568 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 25 04:47:10.076568 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 25 04:47:10.076568 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 25 04:47:10.076568 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 25 04:47:10.076568 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 25 04:47:10.076568 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 04:47:10.076568 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 04:47:10.076568 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 04:47:10.076568 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 04:47:10.076568 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume deab3677-af1a-419a-9d9e-8a3410479d3b could not be found. (HTTP 404) (Request-ID: req-6395c326-04ff-486e-aefc-7476e7e22e13) Sep 25 04:47:10.076568 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:10.076568 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:10.076568 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:10.078224 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:10.078224 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 25 04:47:10.078224 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 25 04:47:10.078224 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 25 04:47:10.078224 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 25 04:47:10.078224 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 25 04:47:10.078224 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 25 04:47:10.078224 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 25 04:47:10.078224 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 25 04:47:10.078224 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 04:47:10.078224 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 04:47:10.078224 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 25 04:47:10.078224 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 25 04:47:10.078224 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 25 04:47:10.078224 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 25 04:47:10.078224 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 25 04:47:10.078224 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 25 04:47:10.078224 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 25 04:47:10.078224 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 25 04:47:10.079536 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 04:47:10.079536 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 04:47:10.079536 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 04:47:10.079536 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 04:47:10.079536 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume deab3677-af1a-419a-9d9e-8a3410479d3b could not be found. Sep 25 04:47:10.079536 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:10.079536 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:10.079536 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:10.079536 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:10.079536 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:10.079536 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:10.079536 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:47:10.079536 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:47:10.079536 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 04:47:10.079536 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 04:47:10.079536 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:47:10.079536 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:47:10.079536 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 25 04:47:10.079536 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:47:10.080906 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume deab3677-af1a-419a-9d9e-8a3410479d3b could not be found. Sep 25 04:47:10.080906 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:10.080906 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:10.080906 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:10.080906 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:10.080906 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:10.080906 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:10.080906 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:47:10.080906 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:47:10.080906 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume deab3677-af1a-419a-9d9e-8a3410479d3b could not be found. Sep 25 04:47:10.080906 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:10.080906 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-120dc924-ac55-41df-9117-7eb4f6c85e57 tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] Returning 404 to user: Volume deab3677-af1a-419a-9d9e-8a3410479d3b could not be found. {{(pid=127141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:47:10.080906 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-120dc924-ac55-41df-9117-7eb4f6c85e57 tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/deab3677-af1a-419a-9d9e-8a3410479d3b" status: 404 len: 109 microversion: 2.1 time: 0.037343 Sep 25 04:47:10.080906 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 514/1096] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Sep 25 04:47:10 2022] GET /compute/v2.1/os-volumes/deab3677-af1a-419a-9d9e-8a3410479d3b => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 04:47:10.090346 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-2bf25686-fa6c-426c-a46b-5211e96122ca tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] Calling method '.version_select at 0x7f4d3ed67940>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:10.118258 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.wsgi [None req-2bf25686-fa6c-426c-a46b-5211e96122ca tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] HTTP exception thrown: Volume deab3677-af1a-419a-9d9e-8a3410479d3b could not be found. Sep 25 04:47:10.120170 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-2bf25686-fa6c-426c-a46b-5211e96122ca tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] Request method failure captured: Sep 25 04:47:10.120170 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: request: DELETE /compute/v2.1/os-volumes/deab3677-af1a-419a-9d9e-8a3410479d3b HTTP/1.1 Sep 25 04:47:10.120170 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept: application/json Sep 25 04:47:10.120170 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept-Encoding: identity Sep 25 04:47:10.120170 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Connection: close Sep 25 04:47:10.120170 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Length: 0 Sep 25 04:47:10.120170 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Type: application/json Sep 25 04:47:10.120170 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Host: 10.222.0.25 Sep 25 04:47:10.120170 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Openstack-System-Scope: None Sep 25 04:47:10.120170 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: User-Agent: python-urllib3/1.26.12 Sep 25 04:47:10.120170 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Auth-Token: gAAAAABjL91EMQA1o3hSM3tp4BeI3qeXE04_u2T7CoQyz9hY78IxbQT6NTs9RqEan4cdbLsjDwC8BDzexKZJT-X7DJGku2MFQYFcz-c1i726sj5kKN6dUeyjoocmKQdCN9Y7c-UsiE2kH4FCHB1vV6hrVNuVf0KnUBSx8j7VwpXCmtB5e_9YOgY Sep 25 04:47:10.120170 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Id: None Sep 25 04:47:10.120170 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Name: None Sep 25 04:47:10.120170 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Identity-Status: Confirmed Sep 25 04:47:10.120170 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Is-Admin-Project: True Sep 25 04:47:10.120170 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Id: default Sep 25 04:47:10.120170 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Name: Default Sep 25 04:47:10.120170 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Id: 51b6143a4c7549d3b0abfabff6e2dbac Sep 25 04:47:10.120170 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2124145483 Sep 25 04:47:10.120170 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Role: reader,member Sep 25 04:47:10.120170 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Roles: reader,member Sep 25 04:47:10.121739 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/51b6143a4c7549d3b0abfabff6e2dbac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/51b6143a4c7549d3b0abfabff6e2dbac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/51b6143a4c7549d3b0abfabff6e2dbac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_51b6143a4c7549d3b0abfabff6e2dbac"}]}] Sep 25 04:47:10.121739 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2124145483 Sep 25 04:47:10.121739 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Id: 51b6143a4c7549d3b0abfabff6e2dbac Sep 25 04:47:10.121739 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2124145483 Sep 25 04:47:10.121739 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User: tempest-VolumesSnapshotsTestJSON-2124145483-project Sep 25 04:47:10.121739 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Id: default Sep 25 04:47:10.121739 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Name: Default Sep 25 04:47:10.121739 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Id: ae7cd2182632480c832e52790cce7095 Sep 25 04:47:10.121739 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2124145483-project Sep 25 04:47:10.121739 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: method: Sep 25 04:47:10.121739 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: exception: Volume deab3677-af1a-419a-9d9e-8a3410479d3b could not be found. Sep 25 04:47:10.121739 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: action_args: {'id': 'deab3677-af1a-419a-9d9e-8a3410479d3b'} Sep 25 04:47:10.121739 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:47:10.122651 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:10.122651 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 04:47:10.122651 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 04:47:10.122651 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 25 04:47:10.122651 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 25 04:47:10.122651 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 25 04:47:10.122651 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 25 04:47:10.122651 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 25 04:47:10.122651 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 25 04:47:10.122651 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 25 04:47:10.122651 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 25 04:47:10.122651 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 04:47:10.122651 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 04:47:10.122651 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 04:47:10.122651 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 04:47:10.122651 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume deab3677-af1a-419a-9d9e-8a3410479d3b could not be found. (HTTP 404) (Request-ID: req-a3800575-33de-41d7-b9fc-985005969ed2) Sep 25 04:47:10.122651 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:10.122651 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:10.122651 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:10.123865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:10.123865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 25 04:47:10.123865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 25 04:47:10.123865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 25 04:47:10.123865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 25 04:47:10.123865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 25 04:47:10.123865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 25 04:47:10.123865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 25 04:47:10.123865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 25 04:47:10.123865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 04:47:10.123865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 04:47:10.123865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 25 04:47:10.123865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 25 04:47:10.123865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 25 04:47:10.123865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 25 04:47:10.123865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 25 04:47:10.123865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 25 04:47:10.123865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 25 04:47:10.123865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 25 04:47:10.125077 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 04:47:10.125077 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 04:47:10.125077 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 04:47:10.125077 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 04:47:10.125077 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume deab3677-af1a-419a-9d9e-8a3410479d3b could not be found. Sep 25 04:47:10.125077 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:10.125077 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:10.125077 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:10.125077 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:10.125077 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:10.125077 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:10.125077 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:47:10.125077 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:47:10.125077 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 04:47:10.125077 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 04:47:10.125077 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:47:10.125077 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:47:10.125077 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 25 04:47:10.125077 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:47:10.127151 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume deab3677-af1a-419a-9d9e-8a3410479d3b could not be found. Sep 25 04:47:10.127151 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:10.127151 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:10.127151 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:10.127151 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:10.127151 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:10.127151 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:10.127151 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:47:10.127151 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:47:10.127151 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume deab3677-af1a-419a-9d9e-8a3410479d3b could not be found. Sep 25 04:47:10.127151 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:10.127151 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-2bf25686-fa6c-426c-a46b-5211e96122ca tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] Returning 404 to user: Volume deab3677-af1a-419a-9d9e-8a3410479d3b could not be found. {{(pid=127142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:47:10.127151 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-2bf25686-fa6c-426c-a46b-5211e96122ca tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/deab3677-af1a-419a-9d9e-8a3410479d3b" status: 404 len: 109 microversion: 2.1 time: 0.035865 Sep 25 04:47:10.128109 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 583/1097] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Sep 25 04:47:10 2022] DELETE /compute/v2.1/os-volumes/deab3677-af1a-419a-9d9e-8a3410479d3b => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 04:47:10.130755 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-f145c6dd-f67d-4dfa-a54c-40b1168b4973 tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] Calling method '.version_select at 0x7f4d3eea5f70>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:10.158930 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.wsgi [None req-f145c6dd-f67d-4dfa-a54c-40b1168b4973 tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] HTTP exception thrown: Volume deab3677-af1a-419a-9d9e-8a3410479d3b could not be found. Sep 25 04:47:10.160940 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-f145c6dd-f67d-4dfa-a54c-40b1168b4973 tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] Request method failure captured: Sep 25 04:47:10.160940 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: request: GET /compute/v2.1/os-volumes/deab3677-af1a-419a-9d9e-8a3410479d3b HTTP/1.1 Sep 25 04:47:10.160940 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept: application/json Sep 25 04:47:10.160940 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept-Encoding: identity Sep 25 04:47:10.160940 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Connection: close Sep 25 04:47:10.160940 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Length: 0 Sep 25 04:47:10.160940 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Type: application/json Sep 25 04:47:10.160940 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Host: 10.222.0.25 Sep 25 04:47:10.160940 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Openstack-System-Scope: None Sep 25 04:47:10.160940 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: User-Agent: python-urllib3/1.26.12 Sep 25 04:47:10.160940 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Auth-Token: gAAAAABjL91EMQA1o3hSM3tp4BeI3qeXE04_u2T7CoQyz9hY78IxbQT6NTs9RqEan4cdbLsjDwC8BDzexKZJT-X7DJGku2MFQYFcz-c1i726sj5kKN6dUeyjoocmKQdCN9Y7c-UsiE2kH4FCHB1vV6hrVNuVf0KnUBSx8j7VwpXCmtB5e_9YOgY Sep 25 04:47:10.160940 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Id: None Sep 25 04:47:10.160940 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Name: None Sep 25 04:47:10.160940 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Identity-Status: Confirmed Sep 25 04:47:10.160940 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Is-Admin-Project: True Sep 25 04:47:10.160940 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Id: default Sep 25 04:47:10.160940 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Name: Default Sep 25 04:47:10.160940 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Id: 51b6143a4c7549d3b0abfabff6e2dbac Sep 25 04:47:10.160940 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2124145483 Sep 25 04:47:10.160940 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Role: reader,member Sep 25 04:47:10.160940 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Roles: reader,member Sep 25 04:47:10.162588 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/51b6143a4c7549d3b0abfabff6e2dbac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/51b6143a4c7549d3b0abfabff6e2dbac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/51b6143a4c7549d3b0abfabff6e2dbac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_51b6143a4c7549d3b0abfabff6e2dbac"}]}] Sep 25 04:47:10.162588 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2124145483 Sep 25 04:47:10.162588 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Id: 51b6143a4c7549d3b0abfabff6e2dbac Sep 25 04:47:10.162588 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2124145483 Sep 25 04:47:10.162588 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User: tempest-VolumesSnapshotsTestJSON-2124145483-project Sep 25 04:47:10.162588 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Id: default Sep 25 04:47:10.162588 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Name: Default Sep 25 04:47:10.162588 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Id: ae7cd2182632480c832e52790cce7095 Sep 25 04:47:10.162588 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2124145483-project Sep 25 04:47:10.162588 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: method: Sep 25 04:47:10.162588 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: exception: Volume deab3677-af1a-419a-9d9e-8a3410479d3b could not be found. Sep 25 04:47:10.162588 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: action_args: {'id': 'deab3677-af1a-419a-9d9e-8a3410479d3b'} Sep 25 04:47:10.162588 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:47:10.163573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:10.163573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 04:47:10.163573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 04:47:10.163573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 25 04:47:10.163573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 25 04:47:10.163573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 25 04:47:10.163573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 25 04:47:10.163573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 25 04:47:10.163573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 25 04:47:10.163573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 25 04:47:10.163573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 25 04:47:10.163573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 04:47:10.163573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 04:47:10.163573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 04:47:10.163573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 04:47:10.163573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume deab3677-af1a-419a-9d9e-8a3410479d3b could not be found. (HTTP 404) (Request-ID: req-6c6ac82e-f461-499d-8f20-d0fe04327cec) Sep 25 04:47:10.163573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:10.163573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:10.163573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:10.164937 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:10.164937 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 25 04:47:10.164937 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 25 04:47:10.164937 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 25 04:47:10.164937 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 25 04:47:10.164937 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 25 04:47:10.164937 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 25 04:47:10.164937 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 25 04:47:10.164937 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 25 04:47:10.164937 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 04:47:10.164937 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 04:47:10.164937 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 25 04:47:10.164937 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 25 04:47:10.164937 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 25 04:47:10.164937 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 25 04:47:10.164937 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 25 04:47:10.164937 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 25 04:47:10.164937 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 25 04:47:10.164937 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 25 04:47:10.166209 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 04:47:10.166209 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 04:47:10.166209 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 04:47:10.166209 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 04:47:10.166209 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume deab3677-af1a-419a-9d9e-8a3410479d3b could not be found. Sep 25 04:47:10.166209 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:10.166209 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:10.166209 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:10.166209 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:10.166209 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:10.166209 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:10.166209 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:47:10.166209 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:47:10.166209 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 04:47:10.166209 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 04:47:10.166209 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:47:10.166209 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:47:10.166209 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 25 04:47:10.166209 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:47:10.167581 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume deab3677-af1a-419a-9d9e-8a3410479d3b could not be found. Sep 25 04:47:10.167581 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:10.167581 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:10.167581 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:10.167581 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:10.167581 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:10.167581 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:10.167581 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:47:10.167581 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:47:10.167581 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume deab3677-af1a-419a-9d9e-8a3410479d3b could not be found. Sep 25 04:47:10.167581 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:10.167581 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-f145c6dd-f67d-4dfa-a54c-40b1168b4973 tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] Returning 404 to user: Volume deab3677-af1a-419a-9d9e-8a3410479d3b could not be found. {{(pid=127141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:47:10.167581 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-f145c6dd-f67d-4dfa-a54c-40b1168b4973 tempest-VolumesSnapshotsTestJSON-2124145483 tempest-VolumesSnapshotsTestJSON-2124145483-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/deab3677-af1a-419a-9d9e-8a3410479d3b" status: 404 len: 109 microversion: 2.1 time: 0.035430 Sep 25 04:47:10.167581 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 515/1098] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Sep 25 04:47:10 2022] GET /compute/v2.1/os-volumes/deab3677-af1a-419a-9d9e-8a3410479d3b => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 04:47:10.372612 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-b3102c9b-1c3c-4272-ae04-c8cf7b332c46 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:10.373795 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-b3102c9b-1c3c-4272-ae04-c8cf7b332c46 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 180dceb1-3b97-4345-b83b-6af39eea407d] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:47:10.380773 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b3102c9b-1c3c-4272-ae04-c8cf7b332c46 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:10.381277 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b3102c9b-1c3c-4272-ae04-c8cf7b332c46 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:10.381721 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b3102c9b-1c3c-4272-ae04-c8cf7b332c46 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:10.382424 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b3102c9b-1c3c-4272-ae04-c8cf7b332c46 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:10.382882 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b3102c9b-1c3c-4272-ae04-c8cf7b332c46 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:10.383318 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b3102c9b-1c3c-4272-ae04-c8cf7b332c46 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:10.407546 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-b3102c9b-1c3c-4272-ae04-c8cf7b332c46 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d/ips" status: 200 len: 151 microversion: 2.1 time: 0.038046 Sep 25 04:47:10.408314 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 584/1099] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Sep 25 04:47:10 2022] GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:47:11.756801 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-bfd5ca13-c6db-46d5-9845-39e68d411958 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4abda85f-2b01-47e0-b1c3-42c96d5238a5"}} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:47:11.759093 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-bfd5ca13-c6db-46d5-9845-39e68d411958 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 180dceb1-3b97-4345-b83b-6af39eea407d] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:47:11.765729 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bfd5ca13-c6db-46d5-9845-39e68d411958 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:11.766165 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bfd5ca13-c6db-46d5-9845-39e68d411958 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:11.766610 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bfd5ca13-c6db-46d5-9845-39e68d411958 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:11.767311 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bfd5ca13-c6db-46d5-9845-39e68d411958 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:11.767771 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bfd5ca13-c6db-46d5-9845-39e68d411958 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:11.768204 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-bfd5ca13-c6db-46d5-9845-39e68d411958 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:12.044282 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-bfd5ca13-c6db-46d5-9845-39e68d411958 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "POST /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292133 Sep 25 04:47:12.044986 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 516/1100] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Sep 25 04:47:11 2022] POST /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:47:20.894649 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-183a9dd8-a8f4-43f9-a519-e2b2e10cf01f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:20.895222 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-183a9dd8-a8f4-43f9-a519-e2b2e10cf01f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 180dceb1-3b97-4345-b83b-6af39eea407d] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:47:20.897606 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_api:SELECT=2 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:47:20.898295 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=4 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:47:20.904621 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-183a9dd8-a8f4-43f9-a519-e2b2e10cf01f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:20.905130 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-183a9dd8-a8f4-43f9-a519-e2b2e10cf01f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:20.905565 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-183a9dd8-a8f4-43f9-a519-e2b2e10cf01f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:20.906998 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-183a9dd8-a8f4-43f9-a519-e2b2e10cf01f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:20.907531 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-183a9dd8-a8f4-43f9-a519-e2b2e10cf01f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:20.907991 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-183a9dd8-a8f4-43f9-a519-e2b2e10cf01f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:20.992557 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.objects.instance [None req-183a9dd8-a8f4-43f9-a519-e2b2e10cf01f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lazy-loading 'services' on Instance uuid 180dceb1-3b97-4345-b83b-6af39eea407d {{(pid=127142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 04:47:21.066319 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-183a9dd8-a8f4-43f9-a519-e2b2e10cf01f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "DELETE /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d/os-volume_attachments/4abda85f-2b01-47e0-b1c3-42c96d5238a5" status: 202 len: 0 microversion: 2.1 time: 0.175563 Sep 25 04:47:21.066985 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 585/1101] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Sep 25 04:47:20 2022] DELETE /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d/os-volume_attachments/4abda85f-2b01-47e0-b1c3-42c96d5238a5 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 04:47:21.076438 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-0f65e3a7-9522-4c2f-81a5-ba93df4b5722 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:21.079725 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-0f65e3a7-9522-4c2f-81a5-ba93df4b5722 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 180dceb1-3b97-4345-b83b-6af39eea407d] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:47:21.086075 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0f65e3a7-9522-4c2f-81a5-ba93df4b5722 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:21.086776 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0f65e3a7-9522-4c2f-81a5-ba93df4b5722 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:21.087211 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0f65e3a7-9522-4c2f-81a5-ba93df4b5722 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:21.087944 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0f65e3a7-9522-4c2f-81a5-ba93df4b5722 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:21.088400 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0f65e3a7-9522-4c2f-81a5-ba93df4b5722 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:21.088857 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0f65e3a7-9522-4c2f-81a5-ba93df4b5722 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:21.119128 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-0f65e3a7-9522-4c2f-81a5-ba93df4b5722 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047547 Sep 25 04:47:21.119696 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 517/1102] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 25 04:47:21 2022] GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:47:22.132822 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-1ea31e2c-b814-47e6-a4b1-891743caed33 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:22.135146 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-1ea31e2c-b814-47e6-a4b1-891743caed33 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 180dceb1-3b97-4345-b83b-6af39eea407d] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:47:22.141944 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1ea31e2c-b814-47e6-a4b1-891743caed33 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:22.142426 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1ea31e2c-b814-47e6-a4b1-891743caed33 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:22.142866 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1ea31e2c-b814-47e6-a4b1-891743caed33 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:22.143555 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1ea31e2c-b814-47e6-a4b1-891743caed33 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:22.144010 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1ea31e2c-b814-47e6-a4b1-891743caed33 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:22.144433 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1ea31e2c-b814-47e6-a4b1-891743caed33 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:22.173628 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-1ea31e2c-b814-47e6-a4b1-891743caed33 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045139 Sep 25 04:47:22.174172 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 586/1103] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Sep 25 04:47:22 2022] GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 04:47:22.238309 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-dfe008af-7b2b-4e85-ab81-d7ff80c9ad6f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:22.238862 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-dfe008af-7b2b-4e85-ab81-d7ff80c9ad6f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 180dceb1-3b97-4345-b83b-6af39eea407d] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:47:22.246160 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-dfe008af-7b2b-4e85-ab81-d7ff80c9ad6f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:22.246657 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-dfe008af-7b2b-4e85-ab81-d7ff80c9ad6f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:22.247097 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-dfe008af-7b2b-4e85-ab81-d7ff80c9ad6f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:22.247798 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-dfe008af-7b2b-4e85-ab81-d7ff80c9ad6f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:22.248322 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-dfe008af-7b2b-4e85-ab81-d7ff80c9ad6f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:22.248780 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-dfe008af-7b2b-4e85-ab81-d7ff80c9ad6f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:22.274263 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-dfe008af-7b2b-4e85-ab81-d7ff80c9ad6f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 180dceb1-3b97-4345-b83b-6af39eea407d] Going to try to terminate instance {{(pid=127141) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 04:47:22.351070 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-dfe008af-7b2b-4e85-ab81-d7ff80c9ad6f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "DELETE /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d" status: 204 len: 0 microversion: 2.1 time: 0.117149 Sep 25 04:47:22.351687 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 518/1104] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 25 04:47:22 2022] DELETE /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 04:47:22.360763 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-21f83c82-50cf-4168-a9b2-bc4b316fcf97 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:22.361384 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-21f83c82-50cf-4168-a9b2-bc4b316fcf97 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 180dceb1-3b97-4345-b83b-6af39eea407d] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:47:22.367491 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-21f83c82-50cf-4168-a9b2-bc4b316fcf97 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:22.367977 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-21f83c82-50cf-4168-a9b2-bc4b316fcf97 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:22.368456 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-21f83c82-50cf-4168-a9b2-bc4b316fcf97 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:22.369394 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-21f83c82-50cf-4168-a9b2-bc4b316fcf97 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:22.370058 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-21f83c82-50cf-4168-a9b2-bc4b316fcf97 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:22.370702 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-21f83c82-50cf-4168-a9b2-bc4b316fcf97 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:22.505845 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-21f83c82-50cf-4168-a9b2-bc4b316fcf97 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:47:22.513664 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-21f83c82-50cf-4168-a9b2-bc4b316fcf97 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d" status: 200 len: 1683 microversion: 2.1 time: 0.157611 Sep 25 04:47:22.514224 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 587/1105] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:47:22 2022] GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:47:23.538321 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-f8073bdb-2417-4a47-b84a-f6be78729431 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:23.539030 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-f8073bdb-2417-4a47-b84a-f6be78729431 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 180dceb1-3b97-4345-b83b-6af39eea407d] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:47:23.545459 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f8073bdb-2417-4a47-b84a-f6be78729431 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:23.545949 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f8073bdb-2417-4a47-b84a-f6be78729431 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:23.546393 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f8073bdb-2417-4a47-b84a-f6be78729431 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:23.547844 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f8073bdb-2417-4a47-b84a-f6be78729431 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:23.548284 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f8073bdb-2417-4a47-b84a-f6be78729431 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:23.548749 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-f8073bdb-2417-4a47-b84a-f6be78729431 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:23.728116 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-f8073bdb-2417-4a47-b84a-f6be78729431 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:47:23.736792 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-f8073bdb-2417-4a47-b84a-f6be78729431 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d" status: 200 len: 1683 microversion: 2.1 time: 0.202669 Sep 25 04:47:23.737361 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 519/1106] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:47:23 2022] GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d => generated 1683 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:47:24.761155 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-1ac4c830-0bbd-4292-848d-aa27e2e596e2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:24.761844 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-1ac4c830-0bbd-4292-848d-aa27e2e596e2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 180dceb1-3b97-4345-b83b-6af39eea407d] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:47:24.769311 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1ac4c830-0bbd-4292-848d-aa27e2e596e2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:24.769802 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1ac4c830-0bbd-4292-848d-aa27e2e596e2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:24.770381 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1ac4c830-0bbd-4292-848d-aa27e2e596e2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:24.771290 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1ac4c830-0bbd-4292-848d-aa27e2e596e2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:24.771752 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1ac4c830-0bbd-4292-848d-aa27e2e596e2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:24.772184 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1ac4c830-0bbd-4292-848d-aa27e2e596e2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:25.016789 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-d8b3a0b2-f8c5-48f8-872e-e7ad6445b281 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:25.017377 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-d8b3a0b2-f8c5-48f8-872e-e7ad6445b281 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: 7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:47:25.037546 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d8b3a0b2-f8c5-48f8-872e-e7ad6445b281 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:25.039175 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d8b3a0b2-f8c5-48f8-872e-e7ad6445b281 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:25.039726 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d8b3a0b2-f8c5-48f8-872e-e7ad6445b281 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:25.041785 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d8b3a0b2-f8c5-48f8-872e-e7ad6445b281 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:25.042562 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d8b3a0b2-f8c5-48f8-872e-e7ad6445b281 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:25.043865 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d8b3a0b2-f8c5-48f8-872e-e7ad6445b281 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:25.084792 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-d8b3a0b2-f8c5-48f8-872e-e7ad6445b281 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: 7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412] Going to try to terminate instance {{(pid=127141) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 04:47:25.101100 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-1ac4c830-0bbd-4292-848d-aa27e2e596e2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:47:25.109845 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-1ac4c830-0bbd-4292-848d-aa27e2e596e2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d" status: 200 len: 1683 microversion: 2.1 time: 0.352652 Sep 25 04:47:25.111238 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 588/1107] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:47:24 2022] GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d => generated 1683 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:47:25.129090 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-61664229-7224-4a33-b715-3b6a3fc4d103 req-6771f060-4be9-4eee-bbc6-93db997937e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412", "tag": "330880c0-b8c8-4d65-8e80-caa25314c870"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:47:25.150856 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-61664229-7224-4a33-b715-3b6a3fc4d103 req-6771f060-4be9-4eee-bbc6-93db997937e4 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:25.151356 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-61664229-7224-4a33-b715-3b6a3fc4d103 req-6771f060-4be9-4eee-bbc6-93db997937e4 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:25.151797 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-61664229-7224-4a33-b715-3b6a3fc4d103 req-6771f060-4be9-4eee-bbc6-93db997937e4 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:25.181449 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-61664229-7224-4a33-b715-3b6a3fc4d103 req-6771f060-4be9-4eee-bbc6-93db997937e4 service nova] Creating event network-changed:330880c0-b8c8-4d65-8e80-caa25314c870 for instance 7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412 on hv-cinder-85535 Sep 25 04:47:25.192202 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-61664229-7224-4a33-b715-3b6a3fc4d103 req-6771f060-4be9-4eee-bbc6-93db997937e4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079047 Sep 25 04:47:25.193461 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 589/1108] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:47:25.222795 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-d8b3a0b2-f8c5-48f8-872e-e7ad6445b281 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412" status: 204 len: 0 microversion: 2.1 time: 0.212001 Sep 25 04:47:25.224090 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 520/1109] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 25 04:47:25 2022] DELETE /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 04:47:25.257128 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-e68c8ab3-0e9d-461e-8c1a-bec16fde776f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:25.258244 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-e68c8ab3-0e9d-461e-8c1a-bec16fde776f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: 7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:47:25.277214 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e68c8ab3-0e9d-461e-8c1a-bec16fde776f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:25.280444 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e68c8ab3-0e9d-461e-8c1a-bec16fde776f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:25.281890 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e68c8ab3-0e9d-461e-8c1a-bec16fde776f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:25.282880 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e68c8ab3-0e9d-461e-8c1a-bec16fde776f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:25.283658 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e68c8ab3-0e9d-461e-8c1a-bec16fde776f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:25.284266 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e68c8ab3-0e9d-461e-8c1a-bec16fde776f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:25.573432 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-e68c8ab3-0e9d-461e-8c1a-bec16fde776f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:47:25.590487 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-e68c8ab3-0e9d-461e-8c1a-bec16fde776f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412" status: 200 len: 1576 microversion: 2.1 time: 0.360958 Sep 25 04:47:25.605762 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 590/1110] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:47:25 2022] GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412 => generated 1576 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:47:26.140284 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-158b92ad-4191-4af5-8169-e5a047814169 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:26.142669 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-158b92ad-4191-4af5-8169-e5a047814169 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 180dceb1-3b97-4345-b83b-6af39eea407d] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:47:26.149173 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-158b92ad-4191-4af5-8169-e5a047814169 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:26.149670 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-158b92ad-4191-4af5-8169-e5a047814169 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:26.150115 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-158b92ad-4191-4af5-8169-e5a047814169 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:26.150820 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-158b92ad-4191-4af5-8169-e5a047814169 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:26.151277 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-158b92ad-4191-4af5-8169-e5a047814169 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:26.151716 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-158b92ad-4191-4af5-8169-e5a047814169 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:26.244757 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-158b92ad-4191-4af5-8169-e5a047814169 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:47:26.253683 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-158b92ad-4191-4af5-8169-e5a047814169 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d" status: 200 len: 1615 microversion: 2.1 time: 0.119756 Sep 25 04:47:26.255409 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 521/1111] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:47:26 2022] GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d => generated 1615 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:47:26.617818 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-99c7cd7f-6d1c-47c6-80e5-b2bee1b765bc tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:26.619115 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-99c7cd7f-6d1c-47c6-80e5-b2bee1b765bc tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: 7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:47:26.627630 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-99c7cd7f-6d1c-47c6-80e5-b2bee1b765bc tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:26.628137 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-99c7cd7f-6d1c-47c6-80e5-b2bee1b765bc tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:26.628581 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-99c7cd7f-6d1c-47c6-80e5-b2bee1b765bc tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:26.629317 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-99c7cd7f-6d1c-47c6-80e5-b2bee1b765bc tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:26.630435 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-99c7cd7f-6d1c-47c6-80e5-b2bee1b765bc tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:26.631030 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-99c7cd7f-6d1c-47c6-80e5-b2bee1b765bc tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:26.842687 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-99c7cd7f-6d1c-47c6-80e5-b2bee1b765bc tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:47:26.852178 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-99c7cd7f-6d1c-47c6-80e5-b2bee1b765bc tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412" status: 200 len: 1576 microversion: 2.1 time: 0.239121 Sep 25 04:47:26.852860 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 591/1112] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:47:26 2022] GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412 => generated 1576 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:47:27.247305 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [req-c8d40a13-7261-47db-bc49-4eaecf10cce8 req-9bc0569f-6be0-4668-a016-f98d28051da6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "180dceb1-3b97-4345-b83b-6af39eea407d", "name": "network-vif-deleted", "tag": "18e015bb-0b7a-4eba-89bb-5e64e021a546"}]} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:47:27.257544 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-c8d40a13-7261-47db-bc49-4eaecf10cce8 req-9bc0569f-6be0-4668-a016-f98d28051da6 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:27.258020 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-c8d40a13-7261-47db-bc49-4eaecf10cce8 req-9bc0569f-6be0-4668-a016-f98d28051da6 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:27.258447 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-c8d40a13-7261-47db-bc49-4eaecf10cce8 req-9bc0569f-6be0-4668-a016-f98d28051da6 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:27.270488 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.compute.server_external_events [req-c8d40a13-7261-47db-bc49-4eaecf10cce8 req-9bc0569f-6be0-4668-a016-f98d28051da6 service nova] Creating event network-vif-deleted:18e015bb-0b7a-4eba-89bb-5e64e021a546 for instance 180dceb1-3b97-4345-b83b-6af39eea407d on hv-cinder-85535 Sep 25 04:47:27.275210 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [req-c8d40a13-7261-47db-bc49-4eaecf10cce8 req-9bc0569f-6be0-4668-a016-f98d28051da6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031797 Sep 25 04:47:27.275786 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 522/1113] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:47:27.279497 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-c05e104c-073d-46dd-a988-885559bedcef tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:27.280112 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-c05e104c-073d-46dd-a988-885559bedcef tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 180dceb1-3b97-4345-b83b-6af39eea407d] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:47:27.286728 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c05e104c-073d-46dd-a988-885559bedcef tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:27.287206 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c05e104c-073d-46dd-a988-885559bedcef tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:27.287636 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c05e104c-073d-46dd-a988-885559bedcef tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:27.288325 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c05e104c-073d-46dd-a988-885559bedcef tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:27.288809 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c05e104c-073d-46dd-a988-885559bedcef tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:27.289233 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c05e104c-073d-46dd-a988-885559bedcef tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:27.319163 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c05e104c-073d-46dd-a988-885559bedcef tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:27.319632 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c05e104c-073d-46dd-a988-885559bedcef tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:27.320070 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c05e104c-073d-46dd-a988-885559bedcef tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:27.320513 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.objects.instance [None req-c05e104c-073d-46dd-a988-885559bedcef tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lazy-loading 'fault' on Instance uuid 180dceb1-3b97-4345-b83b-6af39eea407d {{(pid=127142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 04:47:27.361405 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-c05e104c-073d-46dd-a988-885559bedcef tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50ba6f9a164463eae9a248936e7bf80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ead2221f7f54d6cbea9fc086a089342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:47:27.368974 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-c05e104c-073d-46dd-a988-885559bedcef tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d" status: 200 len: 1331 microversion: 2.1 time: 0.093489 Sep 25 04:47:27.369536 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 592/1114] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:47:27 2022] GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d => generated 1331 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:47:27.878491 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-ebefc804-49e6-4a85-b29e-f63c4048733f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:27.879619 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-ebefc804-49e6-4a85-b29e-f63c4048733f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: 7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:47:27.889412 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ebefc804-49e6-4a85-b29e-f63c4048733f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:27.890860 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ebefc804-49e6-4a85-b29e-f63c4048733f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:27.891862 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ebefc804-49e6-4a85-b29e-f63c4048733f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:27.892889 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ebefc804-49e6-4a85-b29e-f63c4048733f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:27.893889 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ebefc804-49e6-4a85-b29e-f63c4048733f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:27.894539 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ebefc804-49e6-4a85-b29e-f63c4048733f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:28.339847 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-ebefc804-49e6-4a85-b29e-f63c4048733f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:47:28.348409 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-ebefc804-49e6-4a85-b29e-f63c4048733f tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412" status: 200 len: 1458 microversion: 2.1 time: 0.476611 Sep 25 04:47:28.349018 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 523/1115] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:47:27 2022] GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412 => generated 1458 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:47:28.392950 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-1a7d076e-a706-4649-9d89-fb56fded9dbe tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:28.393574 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-1a7d076e-a706-4649-9d89-fb56fded9dbe tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 180dceb1-3b97-4345-b83b-6af39eea407d] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:47:28.400002 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1a7d076e-a706-4649-9d89-fb56fded9dbe tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:28.400493 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1a7d076e-a706-4649-9d89-fb56fded9dbe tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:28.400976 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1a7d076e-a706-4649-9d89-fb56fded9dbe tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:28.401672 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1a7d076e-a706-4649-9d89-fb56fded9dbe tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:28.402126 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1a7d076e-a706-4649-9d89-fb56fded9dbe tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:28.402555 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-1a7d076e-a706-4649-9d89-fb56fded9dbe tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:28.416625 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.wsgi [None req-1a7d076e-a706-4649-9d89-fb56fded9dbe tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] HTTP exception thrown: Instance 180dceb1-3b97-4345-b83b-6af39eea407d could not be found. Sep 25 04:47:28.418341 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-1a7d076e-a706-4649-9d89-fb56fded9dbe tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Request method failure captured: Sep 25 04:47:28.418341 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: request: GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d HTTP/1.1 Sep 25 04:47:28.418341 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept: application/json Sep 25 04:47:28.418341 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept-Encoding: identity Sep 25 04:47:28.418341 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Connection: close Sep 25 04:47:28.418341 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Length: 0 Sep 25 04:47:28.418341 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Type: application/json Sep 25 04:47:28.418341 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Host: 10.222.0.25 Sep 25 04:47:28.418341 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Openstack-System-Scope: None Sep 25 04:47:28.418341 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: User-Agent: python-urllib3/1.26.12 Sep 25 04:47:28.418341 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Auth-Token: gAAAAABjL9qrZElSae56-vG92SlYq1mROXWpWxGFTOD54wjMJs5cfOlxoWE8oAX6RsHfzZAezv5xiCHlYRD_dbdLKAb4-UUsE_8Gy0JkuMwbWForQ70ZIoDPfES94_73P9FeYeuBsh7sfePpFsox-IWSco1U62FJ77nXfz6wXdXOU1pyUSzZLWo Sep 25 04:47:28.418341 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Id: None Sep 25 04:47:28.418341 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Name: None Sep 25 04:47:28.418341 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Identity-Status: Confirmed Sep 25 04:47:28.418341 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Is-Admin-Project: True Sep 25 04:47:28.418341 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Id: default Sep 25 04:47:28.418341 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Name: Default Sep 25 04:47:28.418341 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Id: 5ead2221f7f54d6cbea9fc086a089342 Sep 25 04:47:28.418341 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Name: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:47:28.418341 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Role: reader,member Sep 25 04:47:28.418341 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Roles: reader,member Sep 25 04:47:28.420068 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5ead2221f7f54d6cbea9fc086a089342"}]}] Sep 25 04:47:28.420068 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:47:28.420068 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Id: 5ead2221f7f54d6cbea9fc086a089342 Sep 25 04:47:28.420068 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:47:28.420068 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User: tempest-AttachVolumeNegativeTest-1212083561-project Sep 25 04:47:28.420068 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Id: default Sep 25 04:47:28.420068 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Name: Default Sep 25 04:47:28.420068 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Id: c50ba6f9a164463eae9a248936e7bf80 Sep 25 04:47:28.420068 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Name: tempest-AttachVolumeNegativeTest-1212083561-project Sep 25 04:47:28.420068 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: method: > Sep 25 04:47:28.420068 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: exception: Instance 180dceb1-3b97-4345-b83b-6af39eea407d could not be found. Sep 25 04:47:28.420068 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: action_args: {'id': '180dceb1-3b97-4345-b83b-6af39eea407d'} Sep 25 04:47:28.421023 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:47:28.421023 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:28.421023 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:47:28.421023 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:47:28.421023 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:47:28.421023 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:47:28.421023 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:47:28.421023 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:47:28.421023 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:47:28.421023 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:47:28.421023 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 180dceb1-3b97-4345-b83b-6af39eea407d could not be found. Sep 25 04:47:28.421023 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:28.421023 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:28.421023 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:28.421023 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:28.421023 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:28.421023 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:28.421023 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:47:28.421023 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:47:28.421023 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:47:28.423400 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:47:28.423400 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 04:47:28.423400 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 04:47:28.423400 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:47:28.423400 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:47:28.423400 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:47:28.423400 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:47:28.423400 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 180dceb1-3b97-4345-b83b-6af39eea407d could not be found. Sep 25 04:47:28.423400 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:28.423400 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:28.423400 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:28.423400 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:28.423400 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:28.423400 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:28.423400 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:47:28.423400 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:47:28.423400 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 180dceb1-3b97-4345-b83b-6af39eea407d could not be found. Sep 25 04:47:28.423400 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:28.424948 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-1a7d076e-a706-4649-9d89-fb56fded9dbe tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Returning 404 to user: Instance 180dceb1-3b97-4345-b83b-6af39eea407d could not be found. {{(pid=127142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:47:28.424948 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-1a7d076e-a706-4649-9d89-fb56fded9dbe tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d" status: 404 len: 111 microversion: 2.1 time: 0.031006 Sep 25 04:47:28.424948 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 593/1116] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:47:28 2022] GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 04:47:28.429436 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-4ee9ea70-25e0-4f21-84c6-373c0d02bea1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '.version_select at 0x7f4d3ec218b0>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:28.448917 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-4ee9ea70-25e0-4f21-84c6-373c0d02bea1 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-565036881" status: 202 len: 0 microversion: 2.1 time: 0.023204 Sep 25 04:47:28.449487 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 524/1117] 10.222.0.25 () {58 vars in 1218 bytes} [Sun Sep 25 04:47:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-565036881 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 04:47:29.289107 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-37bf6794-5339-49b4-b30d-ba1f19e7c356 req-46c67ea0-e66b-47da-9d9b-9e07f0e0b806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412", "name": "network-vif-deleted", "tag": "330880c0-b8c8-4d65-8e80-caa25314c870"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:47:29.299865 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-37bf6794-5339-49b4-b30d-ba1f19e7c356 req-46c67ea0-e66b-47da-9d9b-9e07f0e0b806 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:29.300352 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-37bf6794-5339-49b4-b30d-ba1f19e7c356 req-46c67ea0-e66b-47da-9d9b-9e07f0e0b806 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:29.300817 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-37bf6794-5339-49b4-b30d-ba1f19e7c356 req-46c67ea0-e66b-47da-9d9b-9e07f0e0b806 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:29.311878 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-37bf6794-5339-49b4-b30d-ba1f19e7c356 req-46c67ea0-e66b-47da-9d9b-9e07f0e0b806 service nova] Creating event network-vif-deleted:330880c0-b8c8-4d65-8e80-caa25314c870 for instance 7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412 on hv-cinder-85535 Sep 25 04:47:29.317719 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-37bf6794-5339-49b4-b30d-ba1f19e7c356 req-46c67ea0-e66b-47da-9d9b-9e07f0e0b806 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032316 Sep 25 04:47:29.318296 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 594/1118] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 04:47:29.371350 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-7f1bf697-8703-4d78-9e3d-1575be75759a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:29.371969 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-7f1bf697-8703-4d78-9e3d-1575be75759a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: 7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:47:29.380041 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7f1bf697-8703-4d78-9e3d-1575be75759a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:29.380654 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7f1bf697-8703-4d78-9e3d-1575be75759a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:29.381191 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7f1bf697-8703-4d78-9e3d-1575be75759a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:29.381911 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7f1bf697-8703-4d78-9e3d-1575be75759a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:29.382433 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7f1bf697-8703-4d78-9e3d-1575be75759a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:29.382869 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7f1bf697-8703-4d78-9e3d-1575be75759a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:29.415080 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7f1bf697-8703-4d78-9e3d-1575be75759a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:29.415573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7f1bf697-8703-4d78-9e3d-1575be75759a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:29.416042 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7f1bf697-8703-4d78-9e3d-1575be75759a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:29.416495 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.objects.instance [None req-7f1bf697-8703-4d78-9e3d-1575be75759a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lazy-loading 'fault' on Instance uuid 7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412 {{(pid=127141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 04:47:29.467257 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-7f1bf697-8703-4d78-9e3d-1575be75759a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:47:29.483160 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-7f1bf697-8703-4d78-9e3d-1575be75759a tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412" status: 200 len: 1230 microversion: 2.1 time: 0.115654 Sep 25 04:47:29.484550 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 525/1119] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:47:29 2022] GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412 => generated 1230 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:47:30.251193 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-88a61486-7233-4c65-8826-35032b928a6f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:30.251939 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-88a61486-7233-4c65-8826-35032b928a6f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 180dceb1-3b97-4345-b83b-6af39eea407d] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:47:30.258813 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-88a61486-7233-4c65-8826-35032b928a6f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:30.259292 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-88a61486-7233-4c65-8826-35032b928a6f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:30.259792 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-88a61486-7233-4c65-8826-35032b928a6f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:30.260472 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-88a61486-7233-4c65-8826-35032b928a6f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:30.260949 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-88a61486-7233-4c65-8826-35032b928a6f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:30.261371 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-88a61486-7233-4c65-8826-35032b928a6f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:30.277561 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.wsgi [None req-88a61486-7233-4c65-8826-35032b928a6f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] HTTP exception thrown: Instance 180dceb1-3b97-4345-b83b-6af39eea407d could not be found. Sep 25 04:47:30.279225 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-88a61486-7233-4c65-8826-35032b928a6f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Request method failure captured: Sep 25 04:47:30.279225 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: request: DELETE /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d HTTP/1.1 Sep 25 04:47:30.279225 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept: application/json Sep 25 04:47:30.279225 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept-Encoding: identity Sep 25 04:47:30.279225 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Connection: close Sep 25 04:47:30.279225 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Length: 0 Sep 25 04:47:30.279225 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Type: application/json Sep 25 04:47:30.279225 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Host: 10.222.0.25 Sep 25 04:47:30.279225 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Openstack-System-Scope: None Sep 25 04:47:30.279225 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: User-Agent: python-urllib3/1.26.12 Sep 25 04:47:30.279225 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Auth-Token: gAAAAABjL9qrZElSae56-vG92SlYq1mROXWpWxGFTOD54wjMJs5cfOlxoWE8oAX6RsHfzZAezv5xiCHlYRD_dbdLKAb4-UUsE_8Gy0JkuMwbWForQ70ZIoDPfES94_73P9FeYeuBsh7sfePpFsox-IWSco1U62FJ77nXfz6wXdXOU1pyUSzZLWo Sep 25 04:47:30.279225 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Id: None Sep 25 04:47:30.279225 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Name: None Sep 25 04:47:30.279225 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Identity-Status: Confirmed Sep 25 04:47:30.279225 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Is-Admin-Project: True Sep 25 04:47:30.279225 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Id: default Sep 25 04:47:30.279225 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Name: Default Sep 25 04:47:30.279225 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Id: 5ead2221f7f54d6cbea9fc086a089342 Sep 25 04:47:30.279225 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Name: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:47:30.279225 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Role: reader,member Sep 25 04:47:30.279225 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Roles: reader,member Sep 25 04:47:30.281485 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5ead2221f7f54d6cbea9fc086a089342"}]}] Sep 25 04:47:30.281485 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:47:30.281485 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Id: 5ead2221f7f54d6cbea9fc086a089342 Sep 25 04:47:30.281485 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:47:30.281485 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User: tempest-AttachVolumeNegativeTest-1212083561-project Sep 25 04:47:30.281485 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Id: default Sep 25 04:47:30.281485 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Name: Default Sep 25 04:47:30.281485 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Id: c50ba6f9a164463eae9a248936e7bf80 Sep 25 04:47:30.281485 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Name: tempest-AttachVolumeNegativeTest-1212083561-project Sep 25 04:47:30.281485 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: method: > Sep 25 04:47:30.281485 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: exception: Instance 180dceb1-3b97-4345-b83b-6af39eea407d could not be found. Sep 25 04:47:30.281485 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: action_args: {'id': '180dceb1-3b97-4345-b83b-6af39eea407d'} Sep 25 04:47:30.285586 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:47:30.285586 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:30.285586 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:47:30.285586 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:47:30.285586 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:47:30.285586 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:47:30.285586 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:47:30.285586 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:47:30.285586 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:47:30.285586 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:47:30.285586 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 180dceb1-3b97-4345-b83b-6af39eea407d could not be found. Sep 25 04:47:30.285586 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:30.285586 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:30.285586 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:30.285586 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:30.285586 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:30.285586 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:30.285586 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:47:30.285586 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:47:30.285586 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:47:30.287988 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:47:30.287988 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 04:47:30.287988 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 04:47:30.287988 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 04:47:30.287988 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 04:47:30.287988 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:47:30.287988 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:47:30.287988 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:47:30.287988 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:47:30.287988 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 180dceb1-3b97-4345-b83b-6af39eea407d could not be found. Sep 25 04:47:30.287988 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:30.287988 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:30.287988 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:30.287988 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:30.287988 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:30.287988 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:30.287988 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:47:30.287988 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:47:30.287988 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 180dceb1-3b97-4345-b83b-6af39eea407d could not be found. Sep 25 04:47:30.287988 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:30.290667 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-88a61486-7233-4c65-8826-35032b928a6f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Returning 404 to user: Instance 180dceb1-3b97-4345-b83b-6af39eea407d could not be found. {{(pid=127142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:47:30.290667 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-88a61486-7233-4c65-8826-35032b928a6f tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "DELETE /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d" status: 404 len: 111 microversion: 2.1 time: 0.033738 Sep 25 04:47:30.290667 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 595/1120] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 25 04:47:30 2022] DELETE /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 04:47:30.291163 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-4f8be3a6-55be-407c-a5ce-4ce083e5a70b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:30.292323 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-4f8be3a6-55be-407c-a5ce-4ce083e5a70b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 180dceb1-3b97-4345-b83b-6af39eea407d] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:47:30.298462 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4f8be3a6-55be-407c-a5ce-4ce083e5a70b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:30.298958 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4f8be3a6-55be-407c-a5ce-4ce083e5a70b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:30.299403 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4f8be3a6-55be-407c-a5ce-4ce083e5a70b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:30.300101 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4f8be3a6-55be-407c-a5ce-4ce083e5a70b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:30.300561 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4f8be3a6-55be-407c-a5ce-4ce083e5a70b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:30.301037 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-4f8be3a6-55be-407c-a5ce-4ce083e5a70b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:30.315036 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.wsgi [None req-4f8be3a6-55be-407c-a5ce-4ce083e5a70b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] HTTP exception thrown: Instance 180dceb1-3b97-4345-b83b-6af39eea407d could not be found. Sep 25 04:47:30.316685 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-4f8be3a6-55be-407c-a5ce-4ce083e5a70b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Request method failure captured: Sep 25 04:47:30.316685 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: request: GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d HTTP/1.1 Sep 25 04:47:30.316685 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept: application/json Sep 25 04:47:30.316685 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept-Encoding: identity Sep 25 04:47:30.316685 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Connection: close Sep 25 04:47:30.316685 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Length: 0 Sep 25 04:47:30.316685 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Type: application/json Sep 25 04:47:30.316685 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Host: 10.222.0.25 Sep 25 04:47:30.316685 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Openstack-System-Scope: None Sep 25 04:47:30.316685 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: User-Agent: python-urllib3/1.26.12 Sep 25 04:47:30.316685 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Auth-Token: gAAAAABjL9qrZElSae56-vG92SlYq1mROXWpWxGFTOD54wjMJs5cfOlxoWE8oAX6RsHfzZAezv5xiCHlYRD_dbdLKAb4-UUsE_8Gy0JkuMwbWForQ70ZIoDPfES94_73P9FeYeuBsh7sfePpFsox-IWSco1U62FJ77nXfz6wXdXOU1pyUSzZLWo Sep 25 04:47:30.316685 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Id: None Sep 25 04:47:30.316685 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Name: None Sep 25 04:47:30.316685 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Identity-Status: Confirmed Sep 25 04:47:30.316685 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Is-Admin-Project: True Sep 25 04:47:30.316685 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Id: default Sep 25 04:47:30.316685 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Name: Default Sep 25 04:47:30.316685 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Id: 5ead2221f7f54d6cbea9fc086a089342 Sep 25 04:47:30.316685 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Name: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:47:30.316685 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Role: reader,member Sep 25 04:47:30.316685 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Roles: reader,member Sep 25 04:47:30.318165 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5ead2221f7f54d6cbea9fc086a089342"}]}] Sep 25 04:47:30.318165 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:47:30.318165 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Id: 5ead2221f7f54d6cbea9fc086a089342 Sep 25 04:47:30.318165 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:47:30.318165 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User: tempest-AttachVolumeNegativeTest-1212083561-project Sep 25 04:47:30.318165 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Id: default Sep 25 04:47:30.318165 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Name: Default Sep 25 04:47:30.318165 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Id: c50ba6f9a164463eae9a248936e7bf80 Sep 25 04:47:30.318165 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Name: tempest-AttachVolumeNegativeTest-1212083561-project Sep 25 04:47:30.318165 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: method: > Sep 25 04:47:30.318165 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: exception: Instance 180dceb1-3b97-4345-b83b-6af39eea407d could not be found. Sep 25 04:47:30.318165 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: action_args: {'id': '180dceb1-3b97-4345-b83b-6af39eea407d'} Sep 25 04:47:30.322173 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:47:30.322173 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:30.322173 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:47:30.322173 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:47:30.322173 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:47:30.322173 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:47:30.322173 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:47:30.322173 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:47:30.322173 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:47:30.322173 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:47:30.322173 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 180dceb1-3b97-4345-b83b-6af39eea407d could not be found. Sep 25 04:47:30.322173 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:30.322173 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:30.322173 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:30.322173 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:30.322173 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:30.322173 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:30.322173 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:47:30.322173 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:47:30.322173 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:47:30.324183 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:47:30.324183 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 04:47:30.324183 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 04:47:30.324183 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:47:30.324183 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:47:30.324183 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:47:30.324183 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:47:30.324183 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 180dceb1-3b97-4345-b83b-6af39eea407d could not be found. Sep 25 04:47:30.324183 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:30.324183 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:30.324183 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:30.324183 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:30.324183 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:30.324183 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:30.324183 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:47:30.324183 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:47:30.324183 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 180dceb1-3b97-4345-b83b-6af39eea407d could not be found. Sep 25 04:47:30.324183 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:30.326089 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-4f8be3a6-55be-407c-a5ce-4ce083e5a70b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Returning 404 to user: Instance 180dceb1-3b97-4345-b83b-6af39eea407d could not be found. {{(pid=127141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:47:30.326089 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-4f8be3a6-55be-407c-a5ce-4ce083e5a70b tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d" status: 404 len: 111 microversion: 2.1 time: 0.031763 Sep 25 04:47:30.326089 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 526/1121] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:47:30 2022] GET /compute/v2.1/servers/180dceb1-3b97-4345-b83b-6af39eea407d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 04:47:30.507458 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-d76e6e45-1f77-4f09-91e6-39603952eff3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:30.508234 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-d76e6e45-1f77-4f09-91e6-39603952eff3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: 7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:47:30.514393 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d76e6e45-1f77-4f09-91e6-39603952eff3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:30.514878 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d76e6e45-1f77-4f09-91e6-39603952eff3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:30.515973 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d76e6e45-1f77-4f09-91e6-39603952eff3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:30.516731 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d76e6e45-1f77-4f09-91e6-39603952eff3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:30.517188 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d76e6e45-1f77-4f09-91e6-39603952eff3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:30.517620 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d76e6e45-1f77-4f09-91e6-39603952eff3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:30.531288 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.wsgi [None req-d76e6e45-1f77-4f09-91e6-39603952eff3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] HTTP exception thrown: Instance 7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412 could not be found. Sep 25 04:47:30.533045 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-d76e6e45-1f77-4f09-91e6-39603952eff3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Request method failure captured: Sep 25 04:47:30.533045 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: request: GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412 HTTP/1.1 Sep 25 04:47:30.533045 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept: application/json Sep 25 04:47:30.533045 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept-Encoding: identity Sep 25 04:47:30.533045 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Connection: close Sep 25 04:47:30.533045 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Length: 0 Sep 25 04:47:30.533045 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Type: application/json Sep 25 04:47:30.533045 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Host: 10.222.0.25 Sep 25 04:47:30.533045 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Openstack-System-Scope: None Sep 25 04:47:30.533045 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: User-Agent: python-urllib3/1.26.12 Sep 25 04:47:30.533045 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Auth-Token: gAAAAABjL9sBvKJonII0md8Uel-VaQAgJDBD0k2kuAGfH9SCnoHBlY2k63vMVL4xwUfW55iWUBrdtJzrzAbfQzmKa4XNt1K1Q5cgwpxfRII9Uf-ABjlw9jXXQkm1L2JmCwhb2KBUCmKpdykzX8IeoJTJ0Wod09v7wxS1cwHQcTKHQpk-DExyzrs Sep 25 04:47:30.533045 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Id: None Sep 25 04:47:30.533045 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Name: None Sep 25 04:47:30.533045 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Identity-Status: Confirmed Sep 25 04:47:30.533045 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Is-Admin-Project: True Sep 25 04:47:30.533045 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Id: default Sep 25 04:47:30.533045 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Name: Default Sep 25 04:47:30.533045 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Id: 00f66d2c942b419abc8d9d010c5a57f3 Sep 25 04:47:30.533045 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Name: tempest-TestVolumeBootPattern-174108509 Sep 25 04:47:30.533045 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Role: reader,member Sep 25 04:47:30.533045 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Roles: reader,member Sep 25 04:47:30.534699 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/00f66d2c942b419abc8d9d010c5a57f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00f66d2c942b419abc8d9d010c5a57f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00f66d2c942b419abc8d9d010c5a57f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_00f66d2c942b419abc8d9d010c5a57f3"}]}] Sep 25 04:47:30.534699 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant: tempest-TestVolumeBootPattern-174108509 Sep 25 04:47:30.534699 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Id: 00f66d2c942b419abc8d9d010c5a57f3 Sep 25 04:47:30.534699 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Name: tempest-TestVolumeBootPattern-174108509 Sep 25 04:47:30.534699 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User: tempest-TestVolumeBootPattern-174108509-project Sep 25 04:47:30.534699 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Id: default Sep 25 04:47:30.534699 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Name: Default Sep 25 04:47:30.534699 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Id: 329e3f9810b648218dd45a8b489adb1d Sep 25 04:47:30.534699 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Name: tempest-TestVolumeBootPattern-174108509-project Sep 25 04:47:30.534699 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: method: > Sep 25 04:47:30.534699 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: exception: Instance 7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412 could not be found. Sep 25 04:47:30.534699 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: action_args: {'id': '7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412'} Sep 25 04:47:30.535613 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:47:30.535613 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:30.535613 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:47:30.535613 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:47:30.535613 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:47:30.535613 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:47:30.535613 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:47:30.535613 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:47:30.535613 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:47:30.535613 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:47:30.535613 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412 could not be found. Sep 25 04:47:30.535613 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:30.535613 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:30.535613 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:30.535613 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:30.535613 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:30.535613 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:30.535613 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:47:30.535613 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:47:30.535613 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:47:30.537321 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:47:30.537321 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 04:47:30.537321 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 04:47:30.537321 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:47:30.537321 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:47:30.537321 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:47:30.537321 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:47:30.537321 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412 could not be found. Sep 25 04:47:30.537321 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:30.537321 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:30.537321 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:30.537321 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:30.537321 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:30.537321 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:30.537321 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:47:30.537321 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:47:30.537321 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412 could not be found. Sep 25 04:47:30.537321 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:30.539544 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-d76e6e45-1f77-4f09-91e6-39603952eff3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Returning 404 to user: Instance 7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412 could not be found. {{(pid=127142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:47:30.539544 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-d76e6e45-1f77-4f09-91e6-39603952eff3 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412" status: 404 len: 111 microversion: 2.1 time: 0.030932 Sep 25 04:47:30.539544 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 596/1122] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:47:30 2022] GET /compute/v2.1/servers/7e0bc89a-4013-4b3d-aa5b-fe46cb7e8412 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 04:47:31.472833 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-8e75310a-85b0-4372-97f0-d78e5d7ef3ce tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:31.472833 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-8e75310a-85b0-4372-97f0-d78e5d7ef3ce tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 3170bd2b-77a7-44d5-b7ae-c4352013e7c9] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:47:31.478866 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8e75310a-85b0-4372-97f0-d78e5d7ef3ce tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:31.479453 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8e75310a-85b0-4372-97f0-d78e5d7ef3ce tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:31.479961 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8e75310a-85b0-4372-97f0-d78e5d7ef3ce tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:31.480757 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8e75310a-85b0-4372-97f0-d78e5d7ef3ce tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:31.481283 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8e75310a-85b0-4372-97f0-d78e5d7ef3ce tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:31.481966 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8e75310a-85b0-4372-97f0-d78e5d7ef3ce tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:31.496467 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.wsgi [None req-8e75310a-85b0-4372-97f0-d78e5d7ef3ce tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] HTTP exception thrown: Instance 3170bd2b-77a7-44d5-b7ae-c4352013e7c9 could not be found. Sep 25 04:47:31.498064 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-8e75310a-85b0-4372-97f0-d78e5d7ef3ce tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Request method failure captured: Sep 25 04:47:31.498064 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: request: DELETE /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9 HTTP/1.1 Sep 25 04:47:31.498064 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept: application/json Sep 25 04:47:31.498064 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept-Encoding: identity Sep 25 04:47:31.498064 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Connection: close Sep 25 04:47:31.498064 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Length: 0 Sep 25 04:47:31.498064 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Type: application/json Sep 25 04:47:31.498064 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Host: 10.222.0.25 Sep 25 04:47:31.498064 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Openstack-System-Scope: None Sep 25 04:47:31.498064 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: User-Agent: python-urllib3/1.26.12 Sep 25 04:47:31.498064 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Auth-Token: gAAAAABjL9qrZElSae56-vG92SlYq1mROXWpWxGFTOD54wjMJs5cfOlxoWE8oAX6RsHfzZAezv5xiCHlYRD_dbdLKAb4-UUsE_8Gy0JkuMwbWForQ70ZIoDPfES94_73P9FeYeuBsh7sfePpFsox-IWSco1U62FJ77nXfz6wXdXOU1pyUSzZLWo Sep 25 04:47:31.498064 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Id: None Sep 25 04:47:31.498064 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Name: None Sep 25 04:47:31.498064 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Identity-Status: Confirmed Sep 25 04:47:31.498064 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Is-Admin-Project: True Sep 25 04:47:31.498064 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Id: default Sep 25 04:47:31.498064 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Name: Default Sep 25 04:47:31.498064 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Id: 5ead2221f7f54d6cbea9fc086a089342 Sep 25 04:47:31.498064 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Name: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:47:31.498064 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Role: reader,member Sep 25 04:47:31.498064 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Roles: reader,member Sep 25 04:47:31.499874 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5ead2221f7f54d6cbea9fc086a089342"}]}] Sep 25 04:47:31.499874 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:47:31.499874 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Id: 5ead2221f7f54d6cbea9fc086a089342 Sep 25 04:47:31.499874 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:47:31.499874 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User: tempest-AttachVolumeNegativeTest-1212083561-project Sep 25 04:47:31.499874 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Id: default Sep 25 04:47:31.499874 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Name: Default Sep 25 04:47:31.499874 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Id: c50ba6f9a164463eae9a248936e7bf80 Sep 25 04:47:31.499874 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Name: tempest-AttachVolumeNegativeTest-1212083561-project Sep 25 04:47:31.499874 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: method: > Sep 25 04:47:31.499874 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: exception: Instance 3170bd2b-77a7-44d5-b7ae-c4352013e7c9 could not be found. Sep 25 04:47:31.499874 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: action_args: {'id': '3170bd2b-77a7-44d5-b7ae-c4352013e7c9'} Sep 25 04:47:31.501354 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:47:31.501354 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:31.501354 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:47:31.501354 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:47:31.501354 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:47:31.501354 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:47:31.501354 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:47:31.501354 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:47:31.501354 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:47:31.501354 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:47:31.501354 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3170bd2b-77a7-44d5-b7ae-c4352013e7c9 could not be found. Sep 25 04:47:31.501354 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:31.501354 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:31.501354 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:31.501354 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:31.501354 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:31.501354 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:31.501354 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:47:31.501354 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:47:31.501354 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:47:31.502809 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:47:31.502809 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 04:47:31.502809 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 04:47:31.502809 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 04:47:31.502809 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 04:47:31.502809 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:47:31.502809 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:47:31.502809 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:47:31.502809 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:47:31.502809 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3170bd2b-77a7-44d5-b7ae-c4352013e7c9 could not be found. Sep 25 04:47:31.502809 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:31.502809 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:31.502809 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:31.502809 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:31.502809 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:31.502809 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:31.502809 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:47:31.502809 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:47:31.502809 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3170bd2b-77a7-44d5-b7ae-c4352013e7c9 could not be found. Sep 25 04:47:31.502809 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:31.504384 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-8e75310a-85b0-4372-97f0-d78e5d7ef3ce tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Returning 404 to user: Instance 3170bd2b-77a7-44d5-b7ae-c4352013e7c9 could not be found. {{(pid=127141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:47:31.504384 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-8e75310a-85b0-4372-97f0-d78e5d7ef3ce tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9" status: 404 len: 111 microversion: 2.1 time: 0.033689 Sep 25 04:47:31.504384 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 527/1123] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 25 04:47:31 2022] DELETE /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 04:47:31.508939 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-e9afdc51-3055-4210-9cdc-f9c304da0997 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:31.509548 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-e9afdc51-3055-4210-9cdc-f9c304da0997 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: 3170bd2b-77a7-44d5-b7ae-c4352013e7c9] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:47:31.517218 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e9afdc51-3055-4210-9cdc-f9c304da0997 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:31.517708 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e9afdc51-3055-4210-9cdc-f9c304da0997 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:31.518143 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e9afdc51-3055-4210-9cdc-f9c304da0997 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:31.518833 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e9afdc51-3055-4210-9cdc-f9c304da0997 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:31.519280 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e9afdc51-3055-4210-9cdc-f9c304da0997 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:31.519690 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e9afdc51-3055-4210-9cdc-f9c304da0997 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:31.534741 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.wsgi [None req-e9afdc51-3055-4210-9cdc-f9c304da0997 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] HTTP exception thrown: Instance 3170bd2b-77a7-44d5-b7ae-c4352013e7c9 could not be found. Sep 25 04:47:31.536266 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-e9afdc51-3055-4210-9cdc-f9c304da0997 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Request method failure captured: Sep 25 04:47:31.536266 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: request: GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9 HTTP/1.1 Sep 25 04:47:31.536266 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept: application/json Sep 25 04:47:31.536266 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept-Encoding: identity Sep 25 04:47:31.536266 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Connection: close Sep 25 04:47:31.536266 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Length: 0 Sep 25 04:47:31.536266 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Type: application/json Sep 25 04:47:31.536266 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Host: 10.222.0.25 Sep 25 04:47:31.536266 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Openstack-System-Scope: None Sep 25 04:47:31.536266 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: User-Agent: python-urllib3/1.26.12 Sep 25 04:47:31.536266 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Auth-Token: gAAAAABjL9qrZElSae56-vG92SlYq1mROXWpWxGFTOD54wjMJs5cfOlxoWE8oAX6RsHfzZAezv5xiCHlYRD_dbdLKAb4-UUsE_8Gy0JkuMwbWForQ70ZIoDPfES94_73P9FeYeuBsh7sfePpFsox-IWSco1U62FJ77nXfz6wXdXOU1pyUSzZLWo Sep 25 04:47:31.536266 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Id: None Sep 25 04:47:31.536266 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Name: None Sep 25 04:47:31.536266 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Identity-Status: Confirmed Sep 25 04:47:31.536266 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Is-Admin-Project: True Sep 25 04:47:31.536266 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Id: default Sep 25 04:47:31.536266 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Name: Default Sep 25 04:47:31.536266 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Id: 5ead2221f7f54d6cbea9fc086a089342 Sep 25 04:47:31.536266 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Name: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:47:31.536266 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Role: reader,member Sep 25 04:47:31.536266 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Roles: reader,member Sep 25 04:47:31.537948 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5ead2221f7f54d6cbea9fc086a089342"}]}] Sep 25 04:47:31.537948 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:47:31.537948 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Id: 5ead2221f7f54d6cbea9fc086a089342 Sep 25 04:47:31.537948 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:47:31.537948 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User: tempest-AttachVolumeNegativeTest-1212083561-project Sep 25 04:47:31.537948 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Id: default Sep 25 04:47:31.537948 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Name: Default Sep 25 04:47:31.537948 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Id: c50ba6f9a164463eae9a248936e7bf80 Sep 25 04:47:31.537948 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Name: tempest-AttachVolumeNegativeTest-1212083561-project Sep 25 04:47:31.537948 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: method: > Sep 25 04:47:31.537948 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: exception: Instance 3170bd2b-77a7-44d5-b7ae-c4352013e7c9 could not be found. Sep 25 04:47:31.537948 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: action_args: {'id': '3170bd2b-77a7-44d5-b7ae-c4352013e7c9'} Sep 25 04:47:31.538790 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:47:31.538790 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:31.538790 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:47:31.538790 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:47:31.538790 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:47:31.538790 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:47:31.538790 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:47:31.538790 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:47:31.538790 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:47:31.538790 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:47:31.538790 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3170bd2b-77a7-44d5-b7ae-c4352013e7c9 could not be found. Sep 25 04:47:31.538790 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:31.538790 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:31.538790 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:31.538790 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:31.538790 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:31.538790 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:31.538790 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:47:31.538790 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:47:31.538790 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:47:31.540072 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:47:31.540072 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 04:47:31.540072 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 04:47:31.540072 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:47:31.540072 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:47:31.540072 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:47:31.540072 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:47:31.540072 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3170bd2b-77a7-44d5-b7ae-c4352013e7c9 could not be found. Sep 25 04:47:31.540072 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:31.540072 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:31.540072 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:31.540072 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:31.540072 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:31.540072 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:31.540072 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:47:31.540072 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:47:31.540072 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3170bd2b-77a7-44d5-b7ae-c4352013e7c9 could not be found. Sep 25 04:47:31.540072 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:31.541356 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-e9afdc51-3055-4210-9cdc-f9c304da0997 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Returning 404 to user: Instance 3170bd2b-77a7-44d5-b7ae-c4352013e7c9 could not be found. {{(pid=127142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:47:31.541356 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-e9afdc51-3055-4210-9cdc-f9c304da0997 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9" status: 404 len: 111 microversion: 2.1 time: 0.032528 Sep 25 04:47:31.541356 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 597/1124] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:47:31 2022] GET /compute/v2.1/servers/3170bd2b-77a7-44d5-b7ae-c4352013e7c9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 04:47:31.546586 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-187e8ea6-ca74-46bd-b124-35264bdc5ff6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:31.547077 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-187e8ea6-ca74-46bd-b124-35264bdc5ff6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: e1e1377c-3c28-46cb-9832-cebf5ad33679] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:47:31.552975 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-187e8ea6-ca74-46bd-b124-35264bdc5ff6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:31.553464 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-187e8ea6-ca74-46bd-b124-35264bdc5ff6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:31.553901 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-187e8ea6-ca74-46bd-b124-35264bdc5ff6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:31.554590 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-187e8ea6-ca74-46bd-b124-35264bdc5ff6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:31.555038 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-187e8ea6-ca74-46bd-b124-35264bdc5ff6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:31.555458 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-187e8ea6-ca74-46bd-b124-35264bdc5ff6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:31.568911 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.wsgi [None req-187e8ea6-ca74-46bd-b124-35264bdc5ff6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] HTTP exception thrown: Instance e1e1377c-3c28-46cb-9832-cebf5ad33679 could not be found. Sep 25 04:47:31.570432 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-187e8ea6-ca74-46bd-b124-35264bdc5ff6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Request method failure captured: Sep 25 04:47:31.570432 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: request: DELETE /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679 HTTP/1.1 Sep 25 04:47:31.570432 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept: application/json Sep 25 04:47:31.570432 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept-Encoding: identity Sep 25 04:47:31.570432 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Connection: close Sep 25 04:47:31.570432 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Length: 0 Sep 25 04:47:31.570432 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Type: application/json Sep 25 04:47:31.570432 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Host: 10.222.0.25 Sep 25 04:47:31.570432 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Openstack-System-Scope: None Sep 25 04:47:31.570432 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: User-Agent: python-urllib3/1.26.12 Sep 25 04:47:31.570432 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Auth-Token: gAAAAABjL9qrZElSae56-vG92SlYq1mROXWpWxGFTOD54wjMJs5cfOlxoWE8oAX6RsHfzZAezv5xiCHlYRD_dbdLKAb4-UUsE_8Gy0JkuMwbWForQ70ZIoDPfES94_73P9FeYeuBsh7sfePpFsox-IWSco1U62FJ77nXfz6wXdXOU1pyUSzZLWo Sep 25 04:47:31.570432 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Id: None Sep 25 04:47:31.570432 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Name: None Sep 25 04:47:31.570432 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Identity-Status: Confirmed Sep 25 04:47:31.570432 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Is-Admin-Project: True Sep 25 04:47:31.570432 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Id: default Sep 25 04:47:31.570432 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Name: Default Sep 25 04:47:31.570432 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Id: 5ead2221f7f54d6cbea9fc086a089342 Sep 25 04:47:31.570432 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Name: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:47:31.570432 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Role: reader,member Sep 25 04:47:31.570432 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Roles: reader,member Sep 25 04:47:31.572072 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5ead2221f7f54d6cbea9fc086a089342"}]}] Sep 25 04:47:31.572072 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:47:31.572072 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Id: 5ead2221f7f54d6cbea9fc086a089342 Sep 25 04:47:31.572072 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:47:31.572072 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User: tempest-AttachVolumeNegativeTest-1212083561-project Sep 25 04:47:31.572072 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Id: default Sep 25 04:47:31.572072 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Name: Default Sep 25 04:47:31.572072 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Id: c50ba6f9a164463eae9a248936e7bf80 Sep 25 04:47:31.572072 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Name: tempest-AttachVolumeNegativeTest-1212083561-project Sep 25 04:47:31.572072 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: method: > Sep 25 04:47:31.572072 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: exception: Instance e1e1377c-3c28-46cb-9832-cebf5ad33679 could not be found. Sep 25 04:47:31.572072 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: action_args: {'id': 'e1e1377c-3c28-46cb-9832-cebf5ad33679'} Sep 25 04:47:31.573144 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:47:31.573144 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:31.573144 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:47:31.573144 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:47:31.573144 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:47:31.573144 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:47:31.573144 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:47:31.573144 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:47:31.573144 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:47:31.573144 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:47:31.573144 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1e1377c-3c28-46cb-9832-cebf5ad33679 could not be found. Sep 25 04:47:31.573144 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:31.573144 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:31.573144 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:31.573144 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:31.573144 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:31.573144 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:31.573144 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:47:31.573144 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:47:31.573144 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:47:31.574740 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:47:31.574740 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 04:47:31.574740 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 04:47:31.574740 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 04:47:31.574740 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 04:47:31.574740 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:47:31.574740 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:47:31.574740 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:47:31.574740 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:47:31.574740 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1e1377c-3c28-46cb-9832-cebf5ad33679 could not be found. Sep 25 04:47:31.574740 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:31.574740 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:31.574740 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:31.574740 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:31.574740 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:31.574740 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:31.574740 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:47:31.574740 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:47:31.574740 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1e1377c-3c28-46cb-9832-cebf5ad33679 could not be found. Sep 25 04:47:31.574740 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:31.576297 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-187e8ea6-ca74-46bd-b124-35264bdc5ff6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Returning 404 to user: Instance e1e1377c-3c28-46cb-9832-cebf5ad33679 could not be found. {{(pid=127141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:47:31.576297 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-187e8ea6-ca74-46bd-b124-35264bdc5ff6 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679" status: 404 len: 111 microversion: 2.1 time: 0.029171 Sep 25 04:47:31.576297 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 528/1125] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 25 04:47:31 2022] DELETE /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 04:47:31.580711 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-923e4aee-d2ce-4963-9839-4a29c7240f62 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:31.581321 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-923e4aee-d2ce-4963-9839-4a29c7240f62 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: e1e1377c-3c28-46cb-9832-cebf5ad33679] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:47:31.587107 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-923e4aee-d2ce-4963-9839-4a29c7240f62 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:31.587582 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-923e4aee-d2ce-4963-9839-4a29c7240f62 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:31.588011 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-923e4aee-d2ce-4963-9839-4a29c7240f62 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:31.588777 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-923e4aee-d2ce-4963-9839-4a29c7240f62 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:31.589492 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-923e4aee-d2ce-4963-9839-4a29c7240f62 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:31.589914 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-923e4aee-d2ce-4963-9839-4a29c7240f62 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:31.604932 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.wsgi [None req-923e4aee-d2ce-4963-9839-4a29c7240f62 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] HTTP exception thrown: Instance e1e1377c-3c28-46cb-9832-cebf5ad33679 could not be found. Sep 25 04:47:31.606462 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-923e4aee-d2ce-4963-9839-4a29c7240f62 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Request method failure captured: Sep 25 04:47:31.606462 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: request: GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679 HTTP/1.1 Sep 25 04:47:31.606462 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept: application/json Sep 25 04:47:31.606462 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept-Encoding: identity Sep 25 04:47:31.606462 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Connection: close Sep 25 04:47:31.606462 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Length: 0 Sep 25 04:47:31.606462 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Type: application/json Sep 25 04:47:31.606462 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Host: 10.222.0.25 Sep 25 04:47:31.606462 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Openstack-System-Scope: None Sep 25 04:47:31.606462 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: User-Agent: python-urllib3/1.26.12 Sep 25 04:47:31.606462 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Auth-Token: gAAAAABjL9qrZElSae56-vG92SlYq1mROXWpWxGFTOD54wjMJs5cfOlxoWE8oAX6RsHfzZAezv5xiCHlYRD_dbdLKAb4-UUsE_8Gy0JkuMwbWForQ70ZIoDPfES94_73P9FeYeuBsh7sfePpFsox-IWSco1U62FJ77nXfz6wXdXOU1pyUSzZLWo Sep 25 04:47:31.606462 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Id: None Sep 25 04:47:31.606462 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Name: None Sep 25 04:47:31.606462 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Identity-Status: Confirmed Sep 25 04:47:31.606462 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Is-Admin-Project: True Sep 25 04:47:31.606462 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Id: default Sep 25 04:47:31.606462 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Name: Default Sep 25 04:47:31.606462 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Id: 5ead2221f7f54d6cbea9fc086a089342 Sep 25 04:47:31.606462 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Name: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:47:31.606462 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Role: reader,member Sep 25 04:47:31.606462 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Roles: reader,member Sep 25 04:47:31.608177 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5ead2221f7f54d6cbea9fc086a089342"}]}] Sep 25 04:47:31.608177 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:47:31.608177 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Id: 5ead2221f7f54d6cbea9fc086a089342 Sep 25 04:47:31.608177 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:47:31.608177 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User: tempest-AttachVolumeNegativeTest-1212083561-project Sep 25 04:47:31.608177 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Id: default Sep 25 04:47:31.608177 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Name: Default Sep 25 04:47:31.608177 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Id: c50ba6f9a164463eae9a248936e7bf80 Sep 25 04:47:31.608177 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Name: tempest-AttachVolumeNegativeTest-1212083561-project Sep 25 04:47:31.608177 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: method: > Sep 25 04:47:31.608177 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: exception: Instance e1e1377c-3c28-46cb-9832-cebf5ad33679 could not be found. Sep 25 04:47:31.608177 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: action_args: {'id': 'e1e1377c-3c28-46cb-9832-cebf5ad33679'} Sep 25 04:47:31.609319 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:47:31.609319 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:31.609319 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:47:31.609319 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:47:31.609319 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:47:31.609319 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:47:31.609319 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:47:31.609319 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:47:31.609319 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:47:31.609319 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:47:31.609319 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1e1377c-3c28-46cb-9832-cebf5ad33679 could not be found. Sep 25 04:47:31.609319 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:31.609319 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:31.609319 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:31.609319 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:31.609319 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:31.609319 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:31.609319 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:47:31.609319 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:47:31.609319 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:47:31.610872 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:47:31.610872 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 04:47:31.610872 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 04:47:31.610872 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:47:31.610872 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:47:31.610872 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:47:31.610872 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:47:31.610872 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1e1377c-3c28-46cb-9832-cebf5ad33679 could not be found. Sep 25 04:47:31.610872 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:31.610872 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:31.610872 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:31.610872 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:31.610872 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:31.610872 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:31.610872 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:47:31.610872 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:47:31.610872 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1e1377c-3c28-46cb-9832-cebf5ad33679 could not be found. Sep 25 04:47:31.610872 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:31.612577 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-923e4aee-d2ce-4963-9839-4a29c7240f62 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Returning 404 to user: Instance e1e1377c-3c28-46cb-9832-cebf5ad33679 could not be found. {{(pid=127142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:47:31.612577 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-923e4aee-d2ce-4963-9839-4a29c7240f62 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679" status: 404 len: 111 microversion: 2.1 time: 0.031528 Sep 25 04:47:31.612577 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 598/1126] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:47:31 2022] GET /compute/v2.1/servers/e1e1377c-3c28-46cb-9832-cebf5ad33679 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 04:47:32.751565 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-0d1468a4-fa19-4170-bb8f-1778b2b637a2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:32.752072 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-0d1468a4-fa19-4170-bb8f-1778b2b637a2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:47:32.758694 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0d1468a4-fa19-4170-bb8f-1778b2b637a2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:32.759177 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0d1468a4-fa19-4170-bb8f-1778b2b637a2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:32.759616 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0d1468a4-fa19-4170-bb8f-1778b2b637a2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:32.760311 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0d1468a4-fa19-4170-bb8f-1778b2b637a2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:32.760807 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0d1468a4-fa19-4170-bb8f-1778b2b637a2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:32.761244 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0d1468a4-fa19-4170-bb8f-1778b2b637a2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:32.775428 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.wsgi [None req-0d1468a4-fa19-4170-bb8f-1778b2b637a2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] HTTP exception thrown: Instance a31d3c84-7c72-4a2c-970c-b58e15f431f1 could not be found. Sep 25 04:47:32.777059 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-0d1468a4-fa19-4170-bb8f-1778b2b637a2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Request method failure captured: Sep 25 04:47:32.777059 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: request: DELETE /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 HTTP/1.1 Sep 25 04:47:32.777059 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept: application/json Sep 25 04:47:32.777059 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept-Encoding: identity Sep 25 04:47:32.777059 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Connection: close Sep 25 04:47:32.777059 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Length: 0 Sep 25 04:47:32.777059 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Type: application/json Sep 25 04:47:32.777059 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Host: 10.222.0.25 Sep 25 04:47:32.777059 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Openstack-System-Scope: None Sep 25 04:47:32.777059 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: User-Agent: python-urllib3/1.26.12 Sep 25 04:47:32.777059 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Auth-Token: gAAAAABjL9qrZElSae56-vG92SlYq1mROXWpWxGFTOD54wjMJs5cfOlxoWE8oAX6RsHfzZAezv5xiCHlYRD_dbdLKAb4-UUsE_8Gy0JkuMwbWForQ70ZIoDPfES94_73P9FeYeuBsh7sfePpFsox-IWSco1U62FJ77nXfz6wXdXOU1pyUSzZLWo Sep 25 04:47:32.777059 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Id: None Sep 25 04:47:32.777059 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Name: None Sep 25 04:47:32.777059 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Identity-Status: Confirmed Sep 25 04:47:32.777059 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Is-Admin-Project: True Sep 25 04:47:32.777059 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Id: default Sep 25 04:47:32.777059 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Name: Default Sep 25 04:47:32.777059 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Id: 5ead2221f7f54d6cbea9fc086a089342 Sep 25 04:47:32.777059 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Name: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:47:32.777059 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Role: reader,member Sep 25 04:47:32.777059 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Roles: reader,member Sep 25 04:47:32.778708 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5ead2221f7f54d6cbea9fc086a089342"}]}] Sep 25 04:47:32.778708 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:47:32.778708 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Id: 5ead2221f7f54d6cbea9fc086a089342 Sep 25 04:47:32.778708 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:47:32.778708 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User: tempest-AttachVolumeNegativeTest-1212083561-project Sep 25 04:47:32.778708 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Id: default Sep 25 04:47:32.778708 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Name: Default Sep 25 04:47:32.778708 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Id: c50ba6f9a164463eae9a248936e7bf80 Sep 25 04:47:32.778708 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Name: tempest-AttachVolumeNegativeTest-1212083561-project Sep 25 04:47:32.778708 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: method: > Sep 25 04:47:32.778708 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: exception: Instance a31d3c84-7c72-4a2c-970c-b58e15f431f1 could not be found. Sep 25 04:47:32.778708 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: action_args: {'id': 'a31d3c84-7c72-4a2c-970c-b58e15f431f1'} Sep 25 04:47:32.782497 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:47:32.782497 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:32.782497 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:47:32.782497 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:47:32.782497 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:47:32.782497 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:47:32.782497 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:47:32.782497 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:47:32.782497 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:47:32.782497 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:47:32.782497 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a31d3c84-7c72-4a2c-970c-b58e15f431f1 could not be found. Sep 25 04:47:32.782497 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:32.782497 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:32.782497 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:32.782497 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:32.782497 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:32.782497 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:32.782497 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:47:32.782497 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:47:32.782497 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:47:32.784023 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:47:32.784023 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 04:47:32.784023 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 04:47:32.784023 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 04:47:32.784023 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 04:47:32.784023 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:47:32.784023 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:47:32.784023 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:47:32.784023 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:47:32.784023 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a31d3c84-7c72-4a2c-970c-b58e15f431f1 could not be found. Sep 25 04:47:32.784023 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:32.784023 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:32.784023 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:32.784023 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:32.784023 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:32.784023 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:32.784023 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:47:32.784023 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:47:32.784023 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a31d3c84-7c72-4a2c-970c-b58e15f431f1 could not be found. Sep 25 04:47:32.784023 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:32.785701 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-0d1468a4-fa19-4170-bb8f-1778b2b637a2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Returning 404 to user: Instance a31d3c84-7c72-4a2c-970c-b58e15f431f1 could not be found. {{(pid=127141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:47:32.785701 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-0d1468a4-fa19-4170-bb8f-1778b2b637a2 tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 404 len: 111 microversion: 2.1 time: 0.031560 Sep 25 04:47:32.785701 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 529/1127] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 25 04:47:32 2022] DELETE /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 04:47:32.786847 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-5d45b416-61ca-4b10-8290-04edc4bdd6bb tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:32.787466 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-5d45b416-61ca-4b10-8290-04edc4bdd6bb tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] [instance: a31d3c84-7c72-4a2c-970c-b58e15f431f1] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:47:32.793887 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5d45b416-61ca-4b10-8290-04edc4bdd6bb tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:32.794372 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5d45b416-61ca-4b10-8290-04edc4bdd6bb tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:32.794811 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5d45b416-61ca-4b10-8290-04edc4bdd6bb tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:32.795494 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5d45b416-61ca-4b10-8290-04edc4bdd6bb tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:32.795947 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5d45b416-61ca-4b10-8290-04edc4bdd6bb tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:32.796424 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5d45b416-61ca-4b10-8290-04edc4bdd6bb tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:32.809618 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.wsgi [None req-5d45b416-61ca-4b10-8290-04edc4bdd6bb tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] HTTP exception thrown: Instance a31d3c84-7c72-4a2c-970c-b58e15f431f1 could not be found. Sep 25 04:47:32.811118 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-5d45b416-61ca-4b10-8290-04edc4bdd6bb tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Request method failure captured: Sep 25 04:47:32.811118 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: request: GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 HTTP/1.1 Sep 25 04:47:32.811118 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept: application/json Sep 25 04:47:32.811118 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept-Encoding: identity Sep 25 04:47:32.811118 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Connection: close Sep 25 04:47:32.811118 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Length: 0 Sep 25 04:47:32.811118 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Type: application/json Sep 25 04:47:32.811118 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Host: 10.222.0.25 Sep 25 04:47:32.811118 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Openstack-System-Scope: None Sep 25 04:47:32.811118 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: User-Agent: python-urllib3/1.26.12 Sep 25 04:47:32.811118 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Auth-Token: gAAAAABjL9qrZElSae56-vG92SlYq1mROXWpWxGFTOD54wjMJs5cfOlxoWE8oAX6RsHfzZAezv5xiCHlYRD_dbdLKAb4-UUsE_8Gy0JkuMwbWForQ70ZIoDPfES94_73P9FeYeuBsh7sfePpFsox-IWSco1U62FJ77nXfz6wXdXOU1pyUSzZLWo Sep 25 04:47:32.811118 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Id: None Sep 25 04:47:32.811118 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Name: None Sep 25 04:47:32.811118 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Identity-Status: Confirmed Sep 25 04:47:32.811118 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Is-Admin-Project: True Sep 25 04:47:32.811118 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Id: default Sep 25 04:47:32.811118 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Name: Default Sep 25 04:47:32.811118 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Id: 5ead2221f7f54d6cbea9fc086a089342 Sep 25 04:47:32.811118 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Name: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:47:32.811118 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Role: reader,member Sep 25 04:47:32.811118 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Roles: reader,member Sep 25 04:47:32.813507 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ead2221f7f54d6cbea9fc086a089342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5ead2221f7f54d6cbea9fc086a089342"}]}] Sep 25 04:47:32.813507 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:47:32.813507 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Id: 5ead2221f7f54d6cbea9fc086a089342 Sep 25 04:47:32.813507 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1212083561 Sep 25 04:47:32.813507 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User: tempest-AttachVolumeNegativeTest-1212083561-project Sep 25 04:47:32.813507 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Id: default Sep 25 04:47:32.813507 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Name: Default Sep 25 04:47:32.813507 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Id: c50ba6f9a164463eae9a248936e7bf80 Sep 25 04:47:32.813507 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Name: tempest-AttachVolumeNegativeTest-1212083561-project Sep 25 04:47:32.813507 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: method: > Sep 25 04:47:32.813507 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: exception: Instance a31d3c84-7c72-4a2c-970c-b58e15f431f1 could not be found. Sep 25 04:47:32.813507 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: action_args: {'id': 'a31d3c84-7c72-4a2c-970c-b58e15f431f1'} Sep 25 04:47:32.814401 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:47:32.814401 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:32.814401 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:47:32.814401 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:47:32.814401 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:47:32.814401 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:47:32.814401 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:47:32.814401 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:47:32.814401 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:47:32.814401 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:47:32.814401 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a31d3c84-7c72-4a2c-970c-b58e15f431f1 could not be found. Sep 25 04:47:32.814401 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:32.814401 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:32.814401 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:32.814401 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:32.814401 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:32.814401 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:32.814401 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:47:32.814401 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:47:32.814401 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:47:32.815942 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:47:32.815942 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 04:47:32.815942 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 04:47:32.815942 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:47:32.815942 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:47:32.815942 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:47:32.815942 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:47:32.815942 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a31d3c84-7c72-4a2c-970c-b58e15f431f1 could not be found. Sep 25 04:47:32.815942 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:32.815942 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:32.815942 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:32.815942 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:32.815942 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:32.815942 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:32.815942 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:47:32.815942 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:47:32.815942 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a31d3c84-7c72-4a2c-970c-b58e15f431f1 could not be found. Sep 25 04:47:32.815942 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:32.817419 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-5d45b416-61ca-4b10-8290-04edc4bdd6bb tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] Returning 404 to user: Instance a31d3c84-7c72-4a2c-970c-b58e15f431f1 could not be found. {{(pid=127142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:47:32.817419 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-5d45b416-61ca-4b10-8290-04edc4bdd6bb tempest-AttachVolumeNegativeTest-1212083561 tempest-AttachVolumeNegativeTest-1212083561-project] 10.222.0.25 "GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1" status: 404 len: 111 microversion: 2.1 time: 0.029996 Sep 25 04:47:32.817419 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 599/1128] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:47:32 2022] GET /compute/v2.1/servers/a31d3c84-7c72-4a2c-970c-b58e15f431f1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 04:47:34.314047 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-a6c3207b-80bb-4586-a789-e1033df0f407 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:34.314536 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-a6c3207b-80bb-4586-a789-e1033df0f407 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: a88affa4-277d-4c8f-b8ab-5b9fca9e12ec] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:47:34.320988 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-e8ce686d-a247-4203-bb3c-7f3751a71123 req-73c9aaf3-7ca5-4742-9fdd-24fabcd4f4a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a88affa4-277d-4c8f-b8ab-5b9fca9e12ec", "tag": "d940c3fc-ea28-4472-a65e-66e192fca8c0"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:47:34.321566 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a6c3207b-80bb-4586-a789-e1033df0f407 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:34.322078 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a6c3207b-80bb-4586-a789-e1033df0f407 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:34.322564 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a6c3207b-80bb-4586-a789-e1033df0f407 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:34.323311 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a6c3207b-80bb-4586-a789-e1033df0f407 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:34.323773 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a6c3207b-80bb-4586-a789-e1033df0f407 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:34.324196 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a6c3207b-80bb-4586-a789-e1033df0f407 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:34.336506 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-e8ce686d-a247-4203-bb3c-7f3751a71123 req-73c9aaf3-7ca5-4742-9fdd-24fabcd4f4a3 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:34.337023 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-e8ce686d-a247-4203-bb3c-7f3751a71123 req-73c9aaf3-7ca5-4742-9fdd-24fabcd4f4a3 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:34.337457 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-e8ce686d-a247-4203-bb3c-7f3751a71123 req-73c9aaf3-7ca5-4742-9fdd-24fabcd4f4a3 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:34.352335 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-a6c3207b-80bb-4586-a789-e1033df0f407 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: a88affa4-277d-4c8f-b8ab-5b9fca9e12ec] Going to try to terminate instance {{(pid=127141) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 04:47:34.360369 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-e8ce686d-a247-4203-bb3c-7f3751a71123 req-73c9aaf3-7ca5-4742-9fdd-24fabcd4f4a3 service nova] Creating event network-changed:d940c3fc-ea28-4472-a65e-66e192fca8c0 for instance a88affa4-277d-4c8f-b8ab-5b9fca9e12ec on hv-cinder-85535 Sep 25 04:47:34.369399 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-e8ce686d-a247-4203-bb3c-7f3751a71123 req-73c9aaf3-7ca5-4742-9fdd-24fabcd4f4a3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051469 Sep 25 04:47:34.370011 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 600/1129] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 04:47:34.394380 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:47:34.461039 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-a6c3207b-80bb-4586-a789-e1033df0f407 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec" status: 204 len: 0 microversion: 2.1 time: 0.151104 Sep 25 04:47:34.462292 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 530/1130] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 25 04:47:34 2022] DELETE /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 04:47:34.472330 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-c078a34f-86f6-4deb-ac83-a92c2fa94676 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:34.473229 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-c078a34f-86f6-4deb-ac83-a92c2fa94676 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: a88affa4-277d-4c8f-b8ab-5b9fca9e12ec] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:47:34.485461 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c078a34f-86f6-4deb-ac83-a92c2fa94676 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:34.485970 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c078a34f-86f6-4deb-ac83-a92c2fa94676 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:34.486410 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c078a34f-86f6-4deb-ac83-a92c2fa94676 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:34.487273 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c078a34f-86f6-4deb-ac83-a92c2fa94676 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:34.487733 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c078a34f-86f6-4deb-ac83-a92c2fa94676 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:34.488161 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c078a34f-86f6-4deb-ac83-a92c2fa94676 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:35.123772 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-c078a34f-86f6-4deb-ac83-a92c2fa94676 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:47:35.149094 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-c078a34f-86f6-4deb-ac83-a92c2fa94676 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec" status: 200 len: 1577 microversion: 2.1 time: 0.681945 Sep 25 04:47:35.150558 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 601/1131] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:47:34 2022] GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec => generated 1577 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:47:36.174036 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-d47c7e0c-716f-4a6c-9424-079c83f2dccf tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:36.176444 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-d47c7e0c-716f-4a6c-9424-079c83f2dccf tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: a88affa4-277d-4c8f-b8ab-5b9fca9e12ec] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:47:36.183284 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d47c7e0c-716f-4a6c-9424-079c83f2dccf tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:36.184107 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d47c7e0c-716f-4a6c-9424-079c83f2dccf tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:36.184819 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d47c7e0c-716f-4a6c-9424-079c83f2dccf tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:36.185783 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d47c7e0c-716f-4a6c-9424-079c83f2dccf tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:36.186464 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d47c7e0c-716f-4a6c-9424-079c83f2dccf tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:36.187747 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d47c7e0c-716f-4a6c-9424-079c83f2dccf tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:36.505930 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-d47c7e0c-716f-4a6c-9424-079c83f2dccf tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:47:36.514514 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-d47c7e0c-716f-4a6c-9424-079c83f2dccf tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec" status: 200 len: 1458 microversion: 2.1 time: 0.345300 Sep 25 04:47:36.517755 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 531/1132] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:47:36 2022] GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec => generated 1458 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:47:36.638161 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-02521a26-ff29-4eb7-a515-26dd357fc6f9 req-50467d89-b7f8-41ad-b174-e06be7608e72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a88affa4-277d-4c8f-b8ab-5b9fca9e12ec", "name": "network-vif-deleted", "tag": "d940c3fc-ea28-4472-a65e-66e192fca8c0"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:47:36.649591 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-02521a26-ff29-4eb7-a515-26dd357fc6f9 req-50467d89-b7f8-41ad-b174-e06be7608e72 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:36.650369 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-02521a26-ff29-4eb7-a515-26dd357fc6f9 req-50467d89-b7f8-41ad-b174-e06be7608e72 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:36.650753 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-02521a26-ff29-4eb7-a515-26dd357fc6f9 req-50467d89-b7f8-41ad-b174-e06be7608e72 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:36.682357 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-02521a26-ff29-4eb7-a515-26dd357fc6f9 req-50467d89-b7f8-41ad-b174-e06be7608e72 service nova] Creating event network-vif-deleted:d940c3fc-ea28-4472-a65e-66e192fca8c0 for instance a88affa4-277d-4c8f-b8ab-5b9fca9e12ec on hv-cinder-85535 Sep 25 04:47:36.689882 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-02521a26-ff29-4eb7-a515-26dd357fc6f9 req-50467d89-b7f8-41ad-b174-e06be7608e72 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055074 Sep 25 04:47:36.691866 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 602/1133] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:47:37.561826 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-e9a55bce-ee7b-45d4-8189-52845ce69f11 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:37.563797 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-e9a55bce-ee7b-45d4-8189-52845ce69f11 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: a88affa4-277d-4c8f-b8ab-5b9fca9e12ec] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:47:37.571762 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e9a55bce-ee7b-45d4-8189-52845ce69f11 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:37.572251 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e9a55bce-ee7b-45d4-8189-52845ce69f11 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:37.572757 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e9a55bce-ee7b-45d4-8189-52845ce69f11 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:37.573618 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e9a55bce-ee7b-45d4-8189-52845ce69f11 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:37.574085 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e9a55bce-ee7b-45d4-8189-52845ce69f11 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:37.574734 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e9a55bce-ee7b-45d4-8189-52845ce69f11 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:37.619109 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e9a55bce-ee7b-45d4-8189-52845ce69f11 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:37.619614 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e9a55bce-ee7b-45d4-8189-52845ce69f11 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:37.620061 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e9a55bce-ee7b-45d4-8189-52845ce69f11 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:37.620524 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.objects.instance [None req-e9a55bce-ee7b-45d4-8189-52845ce69f11 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lazy-loading 'fault' on Instance uuid a88affa4-277d-4c8f-b8ab-5b9fca9e12ec {{(pid=127141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 04:47:37.755549 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-e9a55bce-ee7b-45d4-8189-52845ce69f11 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e3f9810b648218dd45a8b489adb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f66d2c942b419abc8d9d010c5a57f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:47:37.762656 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-e9a55bce-ee7b-45d4-8189-52845ce69f11 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec" status: 200 len: 1183 microversion: 2.1 time: 0.225213 Sep 25 04:47:37.763223 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 532/1134] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:47:37 2022] GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec => generated 1183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:47:38.787433 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-10ecbc75-f25c-4711-b872-ce8e52646b4b tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:38.788108 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-10ecbc75-f25c-4711-b872-ce8e52646b4b tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: a88affa4-277d-4c8f-b8ab-5b9fca9e12ec] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:47:38.795131 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-10ecbc75-f25c-4711-b872-ce8e52646b4b tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:38.795807 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-10ecbc75-f25c-4711-b872-ce8e52646b4b tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:38.797316 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-10ecbc75-f25c-4711-b872-ce8e52646b4b tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:38.798188 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-10ecbc75-f25c-4711-b872-ce8e52646b4b tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:38.798815 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-10ecbc75-f25c-4711-b872-ce8e52646b4b tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:38.799272 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-10ecbc75-f25c-4711-b872-ce8e52646b4b tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:38.813578 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.wsgi [None req-10ecbc75-f25c-4711-b872-ce8e52646b4b tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] HTTP exception thrown: Instance a88affa4-277d-4c8f-b8ab-5b9fca9e12ec could not be found. Sep 25 04:47:38.815194 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-10ecbc75-f25c-4711-b872-ce8e52646b4b tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Request method failure captured: Sep 25 04:47:38.815194 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: request: GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec HTTP/1.1 Sep 25 04:47:38.815194 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept: application/json Sep 25 04:47:38.815194 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept-Encoding: identity Sep 25 04:47:38.815194 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Connection: close Sep 25 04:47:38.815194 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Length: 0 Sep 25 04:47:38.815194 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Type: application/json Sep 25 04:47:38.815194 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Host: 10.222.0.25 Sep 25 04:47:38.815194 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Openstack-System-Scope: None Sep 25 04:47:38.815194 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: User-Agent: python-urllib3/1.26.12 Sep 25 04:47:38.815194 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Auth-Token: gAAAAABjL9sBvKJonII0md8Uel-VaQAgJDBD0k2kuAGfH9SCnoHBlY2k63vMVL4xwUfW55iWUBrdtJzrzAbfQzmKa4XNt1K1Q5cgwpxfRII9Uf-ABjlw9jXXQkm1L2JmCwhb2KBUCmKpdykzX8IeoJTJ0Wod09v7wxS1cwHQcTKHQpk-DExyzrs Sep 25 04:47:38.815194 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Id: None Sep 25 04:47:38.815194 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Name: None Sep 25 04:47:38.815194 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Identity-Status: Confirmed Sep 25 04:47:38.815194 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Is-Admin-Project: True Sep 25 04:47:38.815194 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Id: default Sep 25 04:47:38.815194 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Name: Default Sep 25 04:47:38.815194 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Id: 00f66d2c942b419abc8d9d010c5a57f3 Sep 25 04:47:38.815194 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Name: tempest-TestVolumeBootPattern-174108509 Sep 25 04:47:38.815194 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Role: reader,member Sep 25 04:47:38.815194 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Roles: reader,member Sep 25 04:47:38.817083 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/00f66d2c942b419abc8d9d010c5a57f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00f66d2c942b419abc8d9d010c5a57f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00f66d2c942b419abc8d9d010c5a57f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_00f66d2c942b419abc8d9d010c5a57f3"}]}] Sep 25 04:47:38.817083 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant: tempest-TestVolumeBootPattern-174108509 Sep 25 04:47:38.817083 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Id: 00f66d2c942b419abc8d9d010c5a57f3 Sep 25 04:47:38.817083 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Name: tempest-TestVolumeBootPattern-174108509 Sep 25 04:47:38.817083 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User: tempest-TestVolumeBootPattern-174108509-project Sep 25 04:47:38.817083 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Id: default Sep 25 04:47:38.817083 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Name: Default Sep 25 04:47:38.817083 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Id: 329e3f9810b648218dd45a8b489adb1d Sep 25 04:47:38.817083 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Name: tempest-TestVolumeBootPattern-174108509-project Sep 25 04:47:38.817083 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: method: > Sep 25 04:47:38.817083 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: exception: Instance a88affa4-277d-4c8f-b8ab-5b9fca9e12ec could not be found. Sep 25 04:47:38.817083 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: action_args: {'id': 'a88affa4-277d-4c8f-b8ab-5b9fca9e12ec'} Sep 25 04:47:38.818186 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:47:38.818186 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:38.818186 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:47:38.818186 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:47:38.818186 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:47:38.818186 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:47:38.818186 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:47:38.818186 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:47:38.818186 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:47:38.818186 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:47:38.818186 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a88affa4-277d-4c8f-b8ab-5b9fca9e12ec could not be found. Sep 25 04:47:38.818186 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:38.818186 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:38.818186 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:38.818186 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:38.818186 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:38.818186 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:38.818186 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:47:38.818186 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:47:38.818186 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:47:38.819719 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:47:38.819719 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 04:47:38.819719 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 04:47:38.819719 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:47:38.819719 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:47:38.819719 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:47:38.819719 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:47:38.819719 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a88affa4-277d-4c8f-b8ab-5b9fca9e12ec could not be found. Sep 25 04:47:38.819719 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:38.819719 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:38.819719 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:38.819719 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:38.819719 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:38.819719 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:38.819719 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:47:38.819719 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:47:38.819719 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a88affa4-277d-4c8f-b8ab-5b9fca9e12ec could not be found. Sep 25 04:47:38.819719 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:38.821080 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-10ecbc75-f25c-4711-b872-ce8e52646b4b tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Returning 404 to user: Instance a88affa4-277d-4c8f-b8ab-5b9fca9e12ec could not be found. {{(pid=127142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:47:38.821080 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-10ecbc75-f25c-4711-b872-ce8e52646b4b tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec" status: 404 len: 111 microversion: 2.1 time: 0.033355 Sep 25 04:47:38.821080 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 603/1135] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:47:38 2022] GET /compute/v2.1/servers/a88affa4-277d-4c8f-b8ab-5b9fca9e12ec => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 04:47:39.322610 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-ca044f45-415c-495a-a398-f16759467489 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:39.323105 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-ca044f45-415c-495a-a398-f16759467489 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: d6138f3e-a927-4d61-890c-ccd60213e4f2] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:47:39.325653 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:47:39.332105 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ca044f45-415c-495a-a398-f16759467489 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:39.332702 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ca044f45-415c-495a-a398-f16759467489 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:39.333201 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ca044f45-415c-495a-a398-f16759467489 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:39.334058 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ca044f45-415c-495a-a398-f16759467489 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:39.334602 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ca044f45-415c-495a-a398-f16759467489 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:39.335140 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ca044f45-415c-495a-a398-f16759467489 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:39.352190 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.wsgi [None req-ca044f45-415c-495a-a398-f16759467489 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] HTTP exception thrown: Instance d6138f3e-a927-4d61-890c-ccd60213e4f2 could not be found. Sep 25 04:47:39.353867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-ca044f45-415c-495a-a398-f16759467489 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Request method failure captured: Sep 25 04:47:39.353867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: request: DELETE /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2 HTTP/1.1 Sep 25 04:47:39.353867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept: application/json Sep 25 04:47:39.353867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept-Encoding: identity Sep 25 04:47:39.353867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Connection: close Sep 25 04:47:39.353867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Length: 0 Sep 25 04:47:39.353867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Type: application/json Sep 25 04:47:39.353867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Host: 10.222.0.25 Sep 25 04:47:39.353867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Openstack-System-Scope: None Sep 25 04:47:39.353867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: User-Agent: python-urllib3/1.26.12 Sep 25 04:47:39.353867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Auth-Token: gAAAAABjL9sBvKJonII0md8Uel-VaQAgJDBD0k2kuAGfH9SCnoHBlY2k63vMVL4xwUfW55iWUBrdtJzrzAbfQzmKa4XNt1K1Q5cgwpxfRII9Uf-ABjlw9jXXQkm1L2JmCwhb2KBUCmKpdykzX8IeoJTJ0Wod09v7wxS1cwHQcTKHQpk-DExyzrs Sep 25 04:47:39.353867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Id: None Sep 25 04:47:39.353867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Name: None Sep 25 04:47:39.353867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Identity-Status: Confirmed Sep 25 04:47:39.353867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Is-Admin-Project: True Sep 25 04:47:39.353867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Id: default Sep 25 04:47:39.353867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Name: Default Sep 25 04:47:39.353867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Id: 00f66d2c942b419abc8d9d010c5a57f3 Sep 25 04:47:39.353867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Name: tempest-TestVolumeBootPattern-174108509 Sep 25 04:47:39.353867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Role: reader,member Sep 25 04:47:39.353867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Roles: reader,member Sep 25 04:47:39.355527 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/00f66d2c942b419abc8d9d010c5a57f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00f66d2c942b419abc8d9d010c5a57f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00f66d2c942b419abc8d9d010c5a57f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_00f66d2c942b419abc8d9d010c5a57f3"}]}] Sep 25 04:47:39.355527 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant: tempest-TestVolumeBootPattern-174108509 Sep 25 04:47:39.355527 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Id: 00f66d2c942b419abc8d9d010c5a57f3 Sep 25 04:47:39.355527 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Name: tempest-TestVolumeBootPattern-174108509 Sep 25 04:47:39.355527 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User: tempest-TestVolumeBootPattern-174108509-project Sep 25 04:47:39.355527 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Id: default Sep 25 04:47:39.355527 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Name: Default Sep 25 04:47:39.355527 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Id: 329e3f9810b648218dd45a8b489adb1d Sep 25 04:47:39.355527 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Name: tempest-TestVolumeBootPattern-174108509-project Sep 25 04:47:39.355527 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: method: > Sep 25 04:47:39.355527 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: exception: Instance d6138f3e-a927-4d61-890c-ccd60213e4f2 could not be found. Sep 25 04:47:39.355527 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: action_args: {'id': 'd6138f3e-a927-4d61-890c-ccd60213e4f2'} Sep 25 04:47:39.356372 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:47:39.356372 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:39.356372 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:47:39.356372 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:47:39.356372 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:47:39.356372 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:47:39.356372 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:47:39.356372 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:47:39.356372 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:47:39.356372 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:47:39.356372 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6138f3e-a927-4d61-890c-ccd60213e4f2 could not be found. Sep 25 04:47:39.356372 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.356372 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:39.356372 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.356372 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:39.356372 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:39.356372 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:39.356372 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:47:39.356372 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:47:39.356372 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:47:39.357797 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:47:39.357797 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 04:47:39.357797 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 04:47:39.357797 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 04:47:39.357797 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 04:47:39.357797 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:47:39.357797 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:47:39.357797 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:47:39.357797 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:47:39.357797 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6138f3e-a927-4d61-890c-ccd60213e4f2 could not be found. Sep 25 04:47:39.357797 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.357797 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:39.357797 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.357797 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:39.357797 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:39.357797 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:39.357797 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:47:39.357797 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:47:39.357797 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6138f3e-a927-4d61-890c-ccd60213e4f2 could not be found. Sep 25 04:47:39.357797 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.359860 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-ca044f45-415c-495a-a398-f16759467489 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Returning 404 to user: Instance d6138f3e-a927-4d61-890c-ccd60213e4f2 could not be found. {{(pid=127141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:47:39.359860 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-ca044f45-415c-495a-a398-f16759467489 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2" status: 404 len: 111 microversion: 2.1 time: 0.036900 Sep 25 04:47:39.359860 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 533/1136] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 25 04:47:39 2022] DELETE /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 04:47:39.365472 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-e694912e-6286-4726-a92e-060ebd16b178 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:39.366085 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-e694912e-6286-4726-a92e-060ebd16b178 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] [instance: d6138f3e-a927-4d61-890c-ccd60213e4f2] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:47:39.373356 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e694912e-6286-4726-a92e-060ebd16b178 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:39.373940 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e694912e-6286-4726-a92e-060ebd16b178 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:39.375188 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e694912e-6286-4726-a92e-060ebd16b178 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:39.376048 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e694912e-6286-4726-a92e-060ebd16b178 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:47:39.376555 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e694912e-6286-4726-a92e-060ebd16b178 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:47:39.377035 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e694912e-6286-4726-a92e-060ebd16b178 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:47:39.392182 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.wsgi [None req-e694912e-6286-4726-a92e-060ebd16b178 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] HTTP exception thrown: Instance d6138f3e-a927-4d61-890c-ccd60213e4f2 could not be found. Sep 25 04:47:39.393747 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-e694912e-6286-4726-a92e-060ebd16b178 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Request method failure captured: Sep 25 04:47:39.393747 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: request: GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2 HTTP/1.1 Sep 25 04:47:39.393747 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept: application/json Sep 25 04:47:39.393747 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept-Encoding: identity Sep 25 04:47:39.393747 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Connection: close Sep 25 04:47:39.393747 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Length: 0 Sep 25 04:47:39.393747 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Type: application/json Sep 25 04:47:39.393747 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Host: 10.222.0.25 Sep 25 04:47:39.393747 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Openstack-System-Scope: None Sep 25 04:47:39.393747 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: User-Agent: python-urllib3/1.26.12 Sep 25 04:47:39.393747 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Auth-Token: gAAAAABjL9sBvKJonII0md8Uel-VaQAgJDBD0k2kuAGfH9SCnoHBlY2k63vMVL4xwUfW55iWUBrdtJzrzAbfQzmKa4XNt1K1Q5cgwpxfRII9Uf-ABjlw9jXXQkm1L2JmCwhb2KBUCmKpdykzX8IeoJTJ0Wod09v7wxS1cwHQcTKHQpk-DExyzrs Sep 25 04:47:39.393747 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Id: None Sep 25 04:47:39.393747 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Name: None Sep 25 04:47:39.393747 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Identity-Status: Confirmed Sep 25 04:47:39.393747 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Is-Admin-Project: True Sep 25 04:47:39.393747 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Id: default Sep 25 04:47:39.393747 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Name: Default Sep 25 04:47:39.393747 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Id: 00f66d2c942b419abc8d9d010c5a57f3 Sep 25 04:47:39.393747 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Name: tempest-TestVolumeBootPattern-174108509 Sep 25 04:47:39.393747 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Role: reader,member Sep 25 04:47:39.393747 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Roles: reader,member Sep 25 04:47:39.395109 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/00f66d2c942b419abc8d9d010c5a57f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00f66d2c942b419abc8d9d010c5a57f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00f66d2c942b419abc8d9d010c5a57f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_00f66d2c942b419abc8d9d010c5a57f3"}]}] Sep 25 04:47:39.395109 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant: tempest-TestVolumeBootPattern-174108509 Sep 25 04:47:39.395109 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Id: 00f66d2c942b419abc8d9d010c5a57f3 Sep 25 04:47:39.395109 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Name: tempest-TestVolumeBootPattern-174108509 Sep 25 04:47:39.395109 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User: tempest-TestVolumeBootPattern-174108509-project Sep 25 04:47:39.395109 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Id: default Sep 25 04:47:39.395109 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Name: Default Sep 25 04:47:39.395109 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Id: 329e3f9810b648218dd45a8b489adb1d Sep 25 04:47:39.395109 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Name: tempest-TestVolumeBootPattern-174108509-project Sep 25 04:47:39.395109 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: method: > Sep 25 04:47:39.395109 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: exception: Instance d6138f3e-a927-4d61-890c-ccd60213e4f2 could not be found. Sep 25 04:47:39.395109 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: action_args: {'id': 'd6138f3e-a927-4d61-890c-ccd60213e4f2'} Sep 25 04:47:39.396018 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:47:39.396018 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:39.396018 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:47:39.396018 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:47:39.396018 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:47:39.396018 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:47:39.396018 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:47:39.396018 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:47:39.396018 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:47:39.396018 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:47:39.396018 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6138f3e-a927-4d61-890c-ccd60213e4f2 could not be found. Sep 25 04:47:39.396018 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.396018 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:39.396018 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.396018 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:39.396018 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:39.396018 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:39.396018 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:47:39.396018 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:47:39.396018 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:47:39.397572 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:47:39.397572 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 04:47:39.397572 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 04:47:39.397572 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:47:39.397572 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:47:39.397572 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:47:39.397572 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:47:39.397572 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6138f3e-a927-4d61-890c-ccd60213e4f2 could not be found. Sep 25 04:47:39.397572 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.397572 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:39.397572 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.397572 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:39.397572 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:39.397572 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:39.397572 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:47:39.397572 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:47:39.397572 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6138f3e-a927-4d61-890c-ccd60213e4f2 could not be found. Sep 25 04:47:39.397572 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.399353 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-e694912e-6286-4726-a92e-060ebd16b178 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Returning 404 to user: Instance d6138f3e-a927-4d61-890c-ccd60213e4f2 could not be found. {{(pid=127142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:47:39.399353 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-e694912e-6286-4726-a92e-060ebd16b178 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2" status: 404 len: 111 microversion: 2.1 time: 0.033769 Sep 25 04:47:39.399353 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 604/1137] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:47:39 2022] GET /compute/v2.1/servers/d6138f3e-a927-4d61-890c-ccd60213e4f2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 04:47:39.610775 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-73b8401e-f672-4293-aa22-3a83d5443828 tempest-VolumesNegativeTest-1255213519 tempest-VolumesNegativeTest-1255213519-project] Action: 'create', calling method: .version_select at 0x7f4d3ee18040>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-566198386", "metadata": {"Type": "work"}}} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:47:39.622995 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-73b8401e-f672-4293-aa22-3a83d5443828 tempest-VolumesNegativeTest-1255213519 tempest-VolumesNegativeTest-1255213519-project] Request method failure captured: Sep 25 04:47:39.622995 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 25 04:47:39.622995 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept: application/json Sep 25 04:47:39.622995 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept-Encoding: identity Sep 25 04:47:39.622995 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Connection: close Sep 25 04:47:39.622995 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Length: 121 Sep 25 04:47:39.622995 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Type: application/json Sep 25 04:47:39.622995 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Host: 10.222.0.25 Sep 25 04:47:39.622995 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Openstack-System-Scope: None Sep 25 04:47:39.622995 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: User-Agent: python-urllib3/1.26.12 Sep 25 04:47:39.622995 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Auth-Token: gAAAAABjL91rllCa-epQ13mp1UZc52JOhsfz-IHve9L2A6ti0dRyBNqcKuTduizZT7APG-kX1MrE8fCUnp7cgWFSG388OTgvKj7LmIOD6VPUWL82fF-c53gzrm2KgifSMWhl2XJ-1VHm229URp6B0Fgrbp_d27en0B2XErS4w9xtADlMxZ0F-XM Sep 25 04:47:39.622995 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Id: None Sep 25 04:47:39.622995 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Name: None Sep 25 04:47:39.622995 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Identity-Status: Confirmed Sep 25 04:47:39.622995 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Is-Admin-Project: True Sep 25 04:47:39.622995 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Id: default Sep 25 04:47:39.622995 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Name: Default Sep 25 04:47:39.622995 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Id: e01ea8b16a414e6a861fd1fee716228a Sep 25 04:47:39.622995 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Name: tempest-VolumesNegativeTest-1255213519 Sep 25 04:47:39.622995 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Role: reader,member Sep 25 04:47:39.622995 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Roles: reader,member Sep 25 04:47:39.625141 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e01ea8b16a414e6a861fd1fee716228a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e01ea8b16a414e6a861fd1fee716228a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e01ea8b16a414e6a861fd1fee716228a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e01ea8b16a414e6a861fd1fee716228a"}]}] Sep 25 04:47:39.625141 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant: tempest-VolumesNegativeTest-1255213519 Sep 25 04:47:39.625141 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Id: e01ea8b16a414e6a861fd1fee716228a Sep 25 04:47:39.625141 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Name: tempest-VolumesNegativeTest-1255213519 Sep 25 04:47:39.625141 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User: tempest-VolumesNegativeTest-1255213519-project Sep 25 04:47:39.625141 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Id: default Sep 25 04:47:39.625141 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Name: Default Sep 25 04:47:39.625141 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Id: 7cbd34954b8444a7aaa8d12ebd2ff4ca Sep 25 04:47:39.625141 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Name: tempest-VolumesNegativeTest-1255213519-project Sep 25 04:47:39.625141 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Sep 25 04:47:39.625141 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-566198386", "metadata": {"Type": "work"}}} Sep 25 04:47:39.625141 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: method: Sep 25 04:47:39.625141 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 25 04:47:39.626138 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-566198386', 'metadata': {'Type': 'work'}}}} Sep 25 04:47:39.626138 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:47:39.626138 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:39.626138 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 04:47:39.626138 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 04:47:39.626138 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 04:47:39.626138 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise error Sep 25 04:47:39.626138 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 25 04:47:39.626138 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.626138 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 25 04:47:39.626138 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 25 04:47:39.626138 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.626138 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 25 04:47:39.626138 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi '#$%' Sep 25 04:47:39.626138 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.626138 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:39.626138 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.626138 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:39.626138 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:39.626138 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:39.626138 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:47:39.626138 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:47:39.627761 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 04:47:39.627761 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 04:47:39.627761 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:47:39.627761 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:47:39.627761 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 04:47:39.627761 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 04:47:39.627761 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 04:47:39.627761 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 04:47:39.627761 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 04:47:39.627761 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 04:47:39.627761 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 25 04:47:39.627761 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.627761 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:39.627761 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.627761 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:39.627761 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:39.627761 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:39.627761 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 04:47:39.627761 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 04:47:39.629251 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 25 04:47:39.629251 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.629251 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-73b8401e-f672-4293-aa22-3a83d5443828 tempest-VolumesNegativeTest-1255213519 tempest-VolumesNegativeTest-1255213519-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:47:39.629251 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-73b8401e-f672-4293-aa22-3a83d5443828 tempest-VolumesNegativeTest-1255213519 tempest-VolumesNegativeTest-1255213519-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.128849 Sep 25 04:47:39.629251 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 534/1138] 10.222.0.25 () {60 vars in 1156 bytes} [Sun Sep 25 04:47:39 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 130 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 04:47:39.634543 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-37e6b66d-a221-4d7d-860c-43cc4121a244 tempest-VolumesNegativeTest-1255213519 tempest-VolumesNegativeTest-1255213519-project] Action: 'create', calling method: .version_select at 0x7f4d3eee3790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-190139406", "metadata": {"Type": "work"}}} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:47:39.639166 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-37e6b66d-a221-4d7d-860c-43cc4121a244 tempest-VolumesNegativeTest-1255213519 tempest-VolumesNegativeTest-1255213519-project] Request method failure captured: Sep 25 04:47:39.639166 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 25 04:47:39.639166 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept: application/json Sep 25 04:47:39.639166 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept-Encoding: identity Sep 25 04:47:39.639166 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Connection: close Sep 25 04:47:39.639166 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Length: 119 Sep 25 04:47:39.639166 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Type: application/json Sep 25 04:47:39.639166 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Host: 10.222.0.25 Sep 25 04:47:39.639166 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Openstack-System-Scope: None Sep 25 04:47:39.639166 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: User-Agent: python-urllib3/1.26.12 Sep 25 04:47:39.639166 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Auth-Token: gAAAAABjL91rllCa-epQ13mp1UZc52JOhsfz-IHve9L2A6ti0dRyBNqcKuTduizZT7APG-kX1MrE8fCUnp7cgWFSG388OTgvKj7LmIOD6VPUWL82fF-c53gzrm2KgifSMWhl2XJ-1VHm229URp6B0Fgrbp_d27en0B2XErS4w9xtADlMxZ0F-XM Sep 25 04:47:39.639166 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Id: None Sep 25 04:47:39.639166 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Name: None Sep 25 04:47:39.639166 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Identity-Status: Confirmed Sep 25 04:47:39.639166 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Is-Admin-Project: True Sep 25 04:47:39.639166 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Id: default Sep 25 04:47:39.639166 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Name: Default Sep 25 04:47:39.639166 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Id: e01ea8b16a414e6a861fd1fee716228a Sep 25 04:47:39.639166 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Name: tempest-VolumesNegativeTest-1255213519 Sep 25 04:47:39.639166 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Role: reader,member Sep 25 04:47:39.639166 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Roles: reader,member Sep 25 04:47:39.640956 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e01ea8b16a414e6a861fd1fee716228a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e01ea8b16a414e6a861fd1fee716228a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e01ea8b16a414e6a861fd1fee716228a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e01ea8b16a414e6a861fd1fee716228a"}]}] Sep 25 04:47:39.640956 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant: tempest-VolumesNegativeTest-1255213519 Sep 25 04:47:39.640956 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Id: e01ea8b16a414e6a861fd1fee716228a Sep 25 04:47:39.640956 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Name: tempest-VolumesNegativeTest-1255213519 Sep 25 04:47:39.640956 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User: tempest-VolumesNegativeTest-1255213519-project Sep 25 04:47:39.640956 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Id: default Sep 25 04:47:39.640956 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Name: Default Sep 25 04:47:39.640956 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Id: 7cbd34954b8444a7aaa8d12ebd2ff4ca Sep 25 04:47:39.640956 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Name: tempest-VolumesNegativeTest-1255213519-project Sep 25 04:47:39.640956 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Sep 25 04:47:39.640956 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-190139406", "metadata": {"Type": "work"}}} Sep 25 04:47:39.640956 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: method: Sep 25 04:47:39.640956 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 25 04:47:39.641923 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-190139406', 'metadata': {'Type': 'work'}}}} Sep 25 04:47:39.641923 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:47:39.641923 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:39.641923 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 04:47:39.641923 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 04:47:39.641923 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 04:47:39.641923 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise error Sep 25 04:47:39.641923 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 25 04:47:39.641923 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.641923 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 25 04:47:39.641923 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 25 04:47:39.641923 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.641923 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 25 04:47:39.641923 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi '0' Sep 25 04:47:39.641923 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.641923 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:39.641923 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.641923 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:39.641923 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:39.641923 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:39.641923 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:47:39.641923 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:47:39.643580 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 04:47:39.643580 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 04:47:39.643580 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:47:39.643580 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:47:39.643580 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 04:47:39.643580 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 04:47:39.643580 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 04:47:39.643580 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 04:47:39.643580 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 04:47:39.643580 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 04:47:39.643580 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 25 04:47:39.643580 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.643580 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:39.643580 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.643580 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:39.643580 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:39.643580 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:39.643580 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 04:47:39.643580 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 04:47:39.645030 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 25 04:47:39.645030 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.645030 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-37e6b66d-a221-4d7d-860c-43cc4121a244 tempest-VolumesNegativeTest-1255213519 tempest-VolumesNegativeTest-1255213519-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:47:39.645030 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-37e6b66d-a221-4d7d-860c-43cc4121a244 tempest-VolumesNegativeTest-1255213519 tempest-VolumesNegativeTest-1255213519-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009766 Sep 25 04:47:39.645030 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 605/1139] 10.222.0.25 () {60 vars in 1156 bytes} [Sun Sep 25 04:47:39 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 04:47:39.649688 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-3af86a5e-e073-4c82-9b87-aed3af765336 tempest-VolumesNegativeTest-1255213519 tempest-VolumesNegativeTest-1255213519-project] Action: 'create', calling method: .version_select at 0x7f4d3eea5700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-795001485", "metadata": {"Type": "work"}}} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:47:39.654606 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-3af86a5e-e073-4c82-9b87-aed3af765336 tempest-VolumesNegativeTest-1255213519 tempest-VolumesNegativeTest-1255213519-project] Request method failure captured: Sep 25 04:47:39.654606 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 25 04:47:39.654606 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept: application/json Sep 25 04:47:39.654606 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept-Encoding: identity Sep 25 04:47:39.654606 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Connection: close Sep 25 04:47:39.654606 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Length: 118 Sep 25 04:47:39.654606 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Type: application/json Sep 25 04:47:39.654606 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Host: 10.222.0.25 Sep 25 04:47:39.654606 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Openstack-System-Scope: None Sep 25 04:47:39.654606 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: User-Agent: python-urllib3/1.26.12 Sep 25 04:47:39.654606 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Auth-Token: gAAAAABjL91rllCa-epQ13mp1UZc52JOhsfz-IHve9L2A6ti0dRyBNqcKuTduizZT7APG-kX1MrE8fCUnp7cgWFSG388OTgvKj7LmIOD6VPUWL82fF-c53gzrm2KgifSMWhl2XJ-1VHm229URp6B0Fgrbp_d27en0B2XErS4w9xtADlMxZ0F-XM Sep 25 04:47:39.654606 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Id: None Sep 25 04:47:39.654606 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Name: None Sep 25 04:47:39.654606 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Identity-Status: Confirmed Sep 25 04:47:39.654606 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Is-Admin-Project: True Sep 25 04:47:39.654606 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Id: default Sep 25 04:47:39.654606 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Name: Default Sep 25 04:47:39.654606 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Id: e01ea8b16a414e6a861fd1fee716228a Sep 25 04:47:39.654606 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Name: tempest-VolumesNegativeTest-1255213519 Sep 25 04:47:39.654606 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Role: reader,member Sep 25 04:47:39.654606 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Roles: reader,member Sep 25 04:47:39.657014 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e01ea8b16a414e6a861fd1fee716228a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e01ea8b16a414e6a861fd1fee716228a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e01ea8b16a414e6a861fd1fee716228a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e01ea8b16a414e6a861fd1fee716228a"}]}] Sep 25 04:47:39.657014 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant: tempest-VolumesNegativeTest-1255213519 Sep 25 04:47:39.657014 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Id: e01ea8b16a414e6a861fd1fee716228a Sep 25 04:47:39.657014 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Name: tempest-VolumesNegativeTest-1255213519 Sep 25 04:47:39.657014 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User: tempest-VolumesNegativeTest-1255213519-project Sep 25 04:47:39.657014 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Id: default Sep 25 04:47:39.657014 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Name: Default Sep 25 04:47:39.657014 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Id: 7cbd34954b8444a7aaa8d12ebd2ff4ca Sep 25 04:47:39.657014 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Name: tempest-VolumesNegativeTest-1255213519-project Sep 25 04:47:39.657014 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Sep 25 04:47:39.657014 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-795001485", "metadata": {"Type": "work"}}} Sep 25 04:47:39.657014 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: method: Sep 25 04:47:39.657014 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 25 04:47:39.658169 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-795001485', 'metadata': {'Type': 'work'}}}} Sep 25 04:47:39.658169 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:47:39.658169 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:39.658169 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 04:47:39.658169 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 04:47:39.658169 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 04:47:39.658169 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise error Sep 25 04:47:39.658169 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 25 04:47:39.658169 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.658169 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 25 04:47:39.658169 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 25 04:47:39.658169 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.658169 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 25 04:47:39.658169 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi '' Sep 25 04:47:39.658169 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.658169 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:39.658169 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.658169 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:39.658169 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:39.658169 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:39.658169 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:47:39.658169 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:47:39.659851 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 04:47:39.659851 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 04:47:39.659851 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:47:39.659851 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:47:39.659851 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 04:47:39.659851 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 04:47:39.659851 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 04:47:39.659851 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 04:47:39.659851 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 04:47:39.659851 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 04:47:39.659851 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 25 04:47:39.659851 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.659851 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:39.659851 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.659851 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:39.659851 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:39.659851 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:39.659851 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 04:47:39.659851 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 04:47:39.661277 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 25 04:47:39.661277 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.661277 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-3af86a5e-e073-4c82-9b87-aed3af765336 tempest-VolumesNegativeTest-1255213519 tempest-VolumesNegativeTest-1255213519-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:47:39.661277 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-3af86a5e-e073-4c82-9b87-aed3af765336 tempest-VolumesNegativeTest-1255213519 tempest-VolumesNegativeTest-1255213519-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010816 Sep 25 04:47:39.661277 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 535/1140] 10.222.0.25 () {60 vars in 1156 bytes} [Sun Sep 25 04:47:39 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 04:47:39.666202 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-b2f85976-83c9-43fb-9fab-1548d4b50dcf tempest-VolumesNegativeTest-1255213519 tempest-VolumesNegativeTest-1255213519-project] Calling method '.version_select at 0x7f4d3ed1d8b0>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:39.696187 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.wsgi [None req-b2f85976-83c9-43fb-9fab-1548d4b50dcf tempest-VolumesNegativeTest-1255213519 tempest-VolumesNegativeTest-1255213519-project] HTTP exception thrown: Volume tempest-invalid-299794187 could not be found. Sep 25 04:47:39.698174 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-b2f85976-83c9-43fb-9fab-1548d4b50dcf tempest-VolumesNegativeTest-1255213519 tempest-VolumesNegativeTest-1255213519-project] Request method failure captured: Sep 25 04:47:39.698174 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-299794187 HTTP/1.1 Sep 25 04:47:39.698174 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept: application/json Sep 25 04:47:39.698174 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept-Encoding: identity Sep 25 04:47:39.698174 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Connection: close Sep 25 04:47:39.698174 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Length: 0 Sep 25 04:47:39.698174 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Type: application/json Sep 25 04:47:39.698174 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Host: 10.222.0.25 Sep 25 04:47:39.698174 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Openstack-System-Scope: None Sep 25 04:47:39.698174 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: User-Agent: python-urllib3/1.26.12 Sep 25 04:47:39.698174 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Auth-Token: gAAAAABjL91rllCa-epQ13mp1UZc52JOhsfz-IHve9L2A6ti0dRyBNqcKuTduizZT7APG-kX1MrE8fCUnp7cgWFSG388OTgvKj7LmIOD6VPUWL82fF-c53gzrm2KgifSMWhl2XJ-1VHm229URp6B0Fgrbp_d27en0B2XErS4w9xtADlMxZ0F-XM Sep 25 04:47:39.698174 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Id: None Sep 25 04:47:39.698174 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Name: None Sep 25 04:47:39.698174 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Identity-Status: Confirmed Sep 25 04:47:39.698174 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Is-Admin-Project: True Sep 25 04:47:39.698174 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Id: default Sep 25 04:47:39.698174 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Name: Default Sep 25 04:47:39.698174 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Id: e01ea8b16a414e6a861fd1fee716228a Sep 25 04:47:39.698174 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Name: tempest-VolumesNegativeTest-1255213519 Sep 25 04:47:39.698174 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Role: reader,member Sep 25 04:47:39.698174 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Roles: reader,member Sep 25 04:47:39.699841 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e01ea8b16a414e6a861fd1fee716228a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e01ea8b16a414e6a861fd1fee716228a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e01ea8b16a414e6a861fd1fee716228a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e01ea8b16a414e6a861fd1fee716228a"}]}] Sep 25 04:47:39.699841 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant: tempest-VolumesNegativeTest-1255213519 Sep 25 04:47:39.699841 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Id: e01ea8b16a414e6a861fd1fee716228a Sep 25 04:47:39.699841 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Name: tempest-VolumesNegativeTest-1255213519 Sep 25 04:47:39.699841 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User: tempest-VolumesNegativeTest-1255213519-project Sep 25 04:47:39.699841 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Id: default Sep 25 04:47:39.699841 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Name: Default Sep 25 04:47:39.699841 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Id: 7cbd34954b8444a7aaa8d12ebd2ff4ca Sep 25 04:47:39.699841 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Name: tempest-VolumesNegativeTest-1255213519-project Sep 25 04:47:39.699841 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: method: Sep 25 04:47:39.699841 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: exception: Volume tempest-invalid-299794187 could not be found. Sep 25 04:47:39.699841 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: action_args: {'id': 'tempest-invalid-299794187'} Sep 25 04:47:39.699841 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:47:39.700905 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:39.700905 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 04:47:39.700905 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 04:47:39.700905 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 25 04:47:39.700905 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 25 04:47:39.700905 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 25 04:47:39.700905 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 25 04:47:39.700905 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 25 04:47:39.700905 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 25 04:47:39.700905 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 25 04:47:39.700905 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 25 04:47:39.700905 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 04:47:39.700905 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 04:47:39.700905 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 04:47:39.700905 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 04:47:39.700905 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-299794187 could not be found. (HTTP 404) (Request-ID: req-bded83ca-e0fd-47ee-a804-0fc1ea366393) Sep 25 04:47:39.700905 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.700905 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:39.700905 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.702544 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:39.702544 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 25 04:47:39.702544 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 25 04:47:39.702544 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 25 04:47:39.702544 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 25 04:47:39.702544 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 25 04:47:39.702544 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 25 04:47:39.702544 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 25 04:47:39.702544 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 25 04:47:39.702544 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 04:47:39.702544 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 04:47:39.702544 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 25 04:47:39.702544 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 25 04:47:39.702544 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 25 04:47:39.702544 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 25 04:47:39.702544 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 25 04:47:39.702544 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 25 04:47:39.702544 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 25 04:47:39.702544 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 25 04:47:39.703983 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 04:47:39.703983 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 04:47:39.703983 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 04:47:39.703983 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 04:47:39.703983 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-299794187 could not be found. Sep 25 04:47:39.703983 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.703983 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:39.703983 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.703983 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:39.703983 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:39.703983 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:39.703983 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:47:39.703983 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:47:39.703983 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 04:47:39.703983 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 04:47:39.703983 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:47:39.703983 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:47:39.703983 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 25 04:47:39.703983 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:47:39.703983 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-299794187 could not be found. Sep 25 04:47:39.705574 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.705574 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:39.705574 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.705574 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:39.705574 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:39.705574 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:39.705574 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:47:39.705574 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:47:39.705574 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-299794187 could not be found. Sep 25 04:47:39.705574 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.705574 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-b2f85976-83c9-43fb-9fab-1548d4b50dcf tempest-VolumesNegativeTest-1255213519 tempest-VolumesNegativeTest-1255213519-project] Returning 404 to user: Volume tempest-invalid-299794187 could not be found. {{(pid=127142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:47:39.705574 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-b2f85976-83c9-43fb-9fab-1548d4b50dcf tempest-VolumesNegativeTest-1255213519 tempest-VolumesNegativeTest-1255213519-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/tempest-invalid-299794187" status: 404 len: 98 microversion: 2.1 time: 0.037068 Sep 25 04:47:39.705574 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 606/1141] 10.222.0.25 () {58 vars in 1215 bytes} [Sun Sep 25 04:47:39 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-299794187 => generated 98 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 25 04:47:39.709260 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-36978682-b6d8-413c-b920-42bc8b9f0151 tempest-VolumesNegativeTest-1255213519 tempest-VolumesNegativeTest-1255213519-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003879 Sep 25 04:47:39.709784 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 536/1142] 10.222.0.25 () {58 vars in 1140 bytes} [Sun Sep 25 04:47:39 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 25 04:47:39.719176 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-8cfb8f1c-8453-47e5-b145-a6294c7c43c5 tempest-VolumesNegativeTest-1255213519 tempest-VolumesNegativeTest-1255213519-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004599 Sep 25 04:47:39.719700 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 607/1143] 10.222.0.25 () {58 vars in 1137 bytes} [Sun Sep 25 04:47:39 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 25 04:47:39.727820 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-4fb44d60-6554-4416-b3d9-91a82abe3001 tempest-VolumesNegativeTest-1255213519 tempest-VolumesNegativeTest-1255213519-project] Calling method '.version_select at 0x7f4d3ee18310>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:39.756500 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.wsgi [None req-4fb44d60-6554-4416-b3d9-91a82abe3001 tempest-VolumesNegativeTest-1255213519 tempest-VolumesNegativeTest-1255213519-project] HTTP exception thrown: Volume 07ffb341-69fe-4728-94b0-96a40efd0728 could not be found. Sep 25 04:47:39.758573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-4fb44d60-6554-4416-b3d9-91a82abe3001 tempest-VolumesNegativeTest-1255213519 tempest-VolumesNegativeTest-1255213519-project] Request method failure captured: Sep 25 04:47:39.758573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: request: DELETE /compute/v2.1/os-volumes/07ffb341-69fe-4728-94b0-96a40efd0728 HTTP/1.1 Sep 25 04:47:39.758573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept: application/json Sep 25 04:47:39.758573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept-Encoding: identity Sep 25 04:47:39.758573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Connection: close Sep 25 04:47:39.758573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Length: 0 Sep 25 04:47:39.758573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Type: application/json Sep 25 04:47:39.758573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Host: 10.222.0.25 Sep 25 04:47:39.758573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Openstack-System-Scope: None Sep 25 04:47:39.758573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: User-Agent: python-urllib3/1.26.12 Sep 25 04:47:39.758573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Auth-Token: gAAAAABjL91rllCa-epQ13mp1UZc52JOhsfz-IHve9L2A6ti0dRyBNqcKuTduizZT7APG-kX1MrE8fCUnp7cgWFSG388OTgvKj7LmIOD6VPUWL82fF-c53gzrm2KgifSMWhl2XJ-1VHm229URp6B0Fgrbp_d27en0B2XErS4w9xtADlMxZ0F-XM Sep 25 04:47:39.758573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Id: None Sep 25 04:47:39.758573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Name: None Sep 25 04:47:39.758573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Identity-Status: Confirmed Sep 25 04:47:39.758573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Is-Admin-Project: True Sep 25 04:47:39.758573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Id: default Sep 25 04:47:39.758573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Name: Default Sep 25 04:47:39.758573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Id: e01ea8b16a414e6a861fd1fee716228a Sep 25 04:47:39.758573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Name: tempest-VolumesNegativeTest-1255213519 Sep 25 04:47:39.758573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Role: reader,member Sep 25 04:47:39.758573 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Roles: reader,member Sep 25 04:47:39.760241 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e01ea8b16a414e6a861fd1fee716228a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e01ea8b16a414e6a861fd1fee716228a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e01ea8b16a414e6a861fd1fee716228a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e01ea8b16a414e6a861fd1fee716228a"}]}] Sep 25 04:47:39.760241 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant: tempest-VolumesNegativeTest-1255213519 Sep 25 04:47:39.760241 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Id: e01ea8b16a414e6a861fd1fee716228a Sep 25 04:47:39.760241 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Name: tempest-VolumesNegativeTest-1255213519 Sep 25 04:47:39.760241 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User: tempest-VolumesNegativeTest-1255213519-project Sep 25 04:47:39.760241 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Id: default Sep 25 04:47:39.760241 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Name: Default Sep 25 04:47:39.760241 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Id: 7cbd34954b8444a7aaa8d12ebd2ff4ca Sep 25 04:47:39.760241 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Name: tempest-VolumesNegativeTest-1255213519-project Sep 25 04:47:39.760241 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: method: Sep 25 04:47:39.760241 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: exception: Volume 07ffb341-69fe-4728-94b0-96a40efd0728 could not be found. Sep 25 04:47:39.760241 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: action_args: {'id': '07ffb341-69fe-4728-94b0-96a40efd0728'} Sep 25 04:47:39.760241 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:47:39.766133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:39.766133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 04:47:39.766133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 04:47:39.766133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 25 04:47:39.766133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 25 04:47:39.766133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 25 04:47:39.766133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 25 04:47:39.766133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 25 04:47:39.766133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 25 04:47:39.766133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 25 04:47:39.766133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 25 04:47:39.766133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 04:47:39.766133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 04:47:39.766133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 04:47:39.766133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 04:47:39.766133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 07ffb341-69fe-4728-94b0-96a40efd0728 could not be found. (HTTP 404) (Request-ID: req-8391ed39-8194-465d-ab3e-97ecbf2f433a) Sep 25 04:47:39.766133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.766133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:39.766133 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.767583 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:39.767583 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 25 04:47:39.767583 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 25 04:47:39.767583 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 25 04:47:39.767583 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 25 04:47:39.767583 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 25 04:47:39.767583 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 25 04:47:39.767583 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 25 04:47:39.767583 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 25 04:47:39.767583 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 04:47:39.767583 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 04:47:39.767583 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 25 04:47:39.767583 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 25 04:47:39.767583 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 25 04:47:39.767583 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 25 04:47:39.767583 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 25 04:47:39.767583 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 25 04:47:39.767583 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 25 04:47:39.767583 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 25 04:47:39.769024 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 04:47:39.769024 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 04:47:39.769024 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 04:47:39.769024 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 04:47:39.769024 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 07ffb341-69fe-4728-94b0-96a40efd0728 could not be found. Sep 25 04:47:39.769024 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.769024 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:39.769024 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.769024 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:39.769024 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:39.769024 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:39.769024 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:47:39.769024 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:47:39.769024 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 04:47:39.769024 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 04:47:39.769024 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:47:39.769024 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:47:39.769024 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 25 04:47:39.769024 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:47:39.770452 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 07ffb341-69fe-4728-94b0-96a40efd0728 could not be found. Sep 25 04:47:39.770452 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.770452 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:39.770452 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.770452 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:39.770452 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:39.770452 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:39.770452 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:47:39.770452 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:47:39.770452 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 07ffb341-69fe-4728-94b0-96a40efd0728 could not be found. Sep 25 04:47:39.770452 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.770452 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-4fb44d60-6554-4416-b3d9-91a82abe3001 tempest-VolumesNegativeTest-1255213519 tempest-VolumesNegativeTest-1255213519-project] Returning 404 to user: Volume 07ffb341-69fe-4728-94b0-96a40efd0728 could not be found. {{(pid=127141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:47:39.770452 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-4fb44d60-6554-4416-b3d9-91a82abe3001 tempest-VolumesNegativeTest-1255213519 tempest-VolumesNegativeTest-1255213519-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/07ffb341-69fe-4728-94b0-96a40efd0728" status: 404 len: 109 microversion: 2.1 time: 0.035807 Sep 25 04:47:39.770452 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 537/1144] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Sep 25 04:47:39 2022] DELETE /compute/v2.1/os-volumes/07ffb341-69fe-4728-94b0-96a40efd0728 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 04:47:39.776477 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-9d6c274c-f9db-4f17-b7c7-e4701587dd35 tempest-VolumesNegativeTest-1255213519 tempest-VolumesNegativeTest-1255213519-project] Calling method '.version_select at 0x7f4d3eb5f8b0>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:39.804025 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.wsgi [None req-9d6c274c-f9db-4f17-b7c7-e4701587dd35 tempest-VolumesNegativeTest-1255213519 tempest-VolumesNegativeTest-1255213519-project] HTTP exception thrown: Volume 505a1995-f510-4717-8ff3-3399cdf62f0a could not be found. Sep 25 04:47:39.806104 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-9d6c274c-f9db-4f17-b7c7-e4701587dd35 tempest-VolumesNegativeTest-1255213519 tempest-VolumesNegativeTest-1255213519-project] Request method failure captured: Sep 25 04:47:39.806104 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: request: GET /compute/v2.1/os-volumes/505a1995-f510-4717-8ff3-3399cdf62f0a HTTP/1.1 Sep 25 04:47:39.806104 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept: application/json Sep 25 04:47:39.806104 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept-Encoding: identity Sep 25 04:47:39.806104 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Connection: close Sep 25 04:47:39.806104 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Length: 0 Sep 25 04:47:39.806104 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Type: application/json Sep 25 04:47:39.806104 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Host: 10.222.0.25 Sep 25 04:47:39.806104 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Openstack-System-Scope: None Sep 25 04:47:39.806104 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: User-Agent: python-urllib3/1.26.12 Sep 25 04:47:39.806104 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Auth-Token: gAAAAABjL91rllCa-epQ13mp1UZc52JOhsfz-IHve9L2A6ti0dRyBNqcKuTduizZT7APG-kX1MrE8fCUnp7cgWFSG388OTgvKj7LmIOD6VPUWL82fF-c53gzrm2KgifSMWhl2XJ-1VHm229URp6B0Fgrbp_d27en0B2XErS4w9xtADlMxZ0F-XM Sep 25 04:47:39.806104 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Id: None Sep 25 04:47:39.806104 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Name: None Sep 25 04:47:39.806104 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Identity-Status: Confirmed Sep 25 04:47:39.806104 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Is-Admin-Project: True Sep 25 04:47:39.806104 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Id: default Sep 25 04:47:39.806104 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Name: Default Sep 25 04:47:39.806104 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Id: e01ea8b16a414e6a861fd1fee716228a Sep 25 04:47:39.806104 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Name: tempest-VolumesNegativeTest-1255213519 Sep 25 04:47:39.806104 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Role: reader,member Sep 25 04:47:39.806104 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Roles: reader,member Sep 25 04:47:39.807771 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e01ea8b16a414e6a861fd1fee716228a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e01ea8b16a414e6a861fd1fee716228a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e01ea8b16a414e6a861fd1fee716228a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e01ea8b16a414e6a861fd1fee716228a"}]}] Sep 25 04:47:39.807771 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant: tempest-VolumesNegativeTest-1255213519 Sep 25 04:47:39.807771 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Id: e01ea8b16a414e6a861fd1fee716228a Sep 25 04:47:39.807771 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Name: tempest-VolumesNegativeTest-1255213519 Sep 25 04:47:39.807771 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User: tempest-VolumesNegativeTest-1255213519-project Sep 25 04:47:39.807771 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Id: default Sep 25 04:47:39.807771 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Name: Default Sep 25 04:47:39.807771 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Id: 7cbd34954b8444a7aaa8d12ebd2ff4ca Sep 25 04:47:39.807771 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Name: tempest-VolumesNegativeTest-1255213519-project Sep 25 04:47:39.807771 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: method: Sep 25 04:47:39.807771 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: exception: Volume 505a1995-f510-4717-8ff3-3399cdf62f0a could not be found. Sep 25 04:47:39.807771 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: action_args: {'id': '505a1995-f510-4717-8ff3-3399cdf62f0a'} Sep 25 04:47:39.807771 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:47:39.808728 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:39.808728 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 04:47:39.808728 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 04:47:39.808728 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 25 04:47:39.808728 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 25 04:47:39.808728 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 25 04:47:39.808728 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 25 04:47:39.808728 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 25 04:47:39.808728 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 25 04:47:39.808728 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 25 04:47:39.808728 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 25 04:47:39.808728 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 04:47:39.808728 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 04:47:39.808728 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 04:47:39.808728 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 04:47:39.808728 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 505a1995-f510-4717-8ff3-3399cdf62f0a could not be found. (HTTP 404) (Request-ID: req-f4fce7de-53eb-4729-80d3-7473762d1cdd) Sep 25 04:47:39.808728 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.808728 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:39.808728 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.809971 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:39.809971 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 25 04:47:39.809971 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 25 04:47:39.809971 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 25 04:47:39.809971 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 25 04:47:39.809971 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 25 04:47:39.809971 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 25 04:47:39.809971 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 25 04:47:39.809971 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 25 04:47:39.809971 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 04:47:39.809971 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 04:47:39.809971 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 25 04:47:39.809971 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 25 04:47:39.809971 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 25 04:47:39.809971 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 25 04:47:39.809971 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 25 04:47:39.809971 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 25 04:47:39.809971 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 25 04:47:39.809971 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 25 04:47:39.811270 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 04:47:39.811270 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 04:47:39.811270 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 04:47:39.811270 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 04:47:39.811270 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 505a1995-f510-4717-8ff3-3399cdf62f0a could not be found. Sep 25 04:47:39.811270 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.811270 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:39.811270 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.811270 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:39.811270 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:39.811270 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:39.811270 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:47:39.811270 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:47:39.811270 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 04:47:39.811270 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 04:47:39.811270 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:47:39.811270 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:47:39.811270 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 25 04:47:39.811270 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:47:39.812833 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 505a1995-f510-4717-8ff3-3399cdf62f0a could not be found. Sep 25 04:47:39.812833 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.812833 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:47:39.812833 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.812833 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:47:39.812833 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:47:39.812833 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:47:39.812833 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:47:39.812833 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:47:39.812833 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 505a1995-f510-4717-8ff3-3399cdf62f0a could not be found. Sep 25 04:47:39.812833 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:47:39.812833 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-9d6c274c-f9db-4f17-b7c7-e4701587dd35 tempest-VolumesNegativeTest-1255213519 tempest-VolumesNegativeTest-1255213519-project] Returning 404 to user: Volume 505a1995-f510-4717-8ff3-3399cdf62f0a could not be found. {{(pid=127142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:47:39.812833 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-9d6c274c-f9db-4f17-b7c7-e4701587dd35 tempest-VolumesNegativeTest-1255213519 tempest-VolumesNegativeTest-1255213519-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/505a1995-f510-4717-8ff3-3399cdf62f0a" status: 404 len: 109 microversion: 2.1 time: 0.034752 Sep 25 04:47:39.812833 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 608/1145] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Sep 25 04:47:39 2022] GET /compute/v2.1/os-volumes/505a1995-f510-4717-8ff3-3399cdf62f0a => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 04:47:43.877531 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 25 04:47:43.878011 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Sun Sep 25 04:47:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-363590622 (ip 10.222.0.25) !!! Sep 25 04:47:43.882288 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-7a70bdfb-282b-41df-b7c1-aa206aafce03 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] Calling method '.version_select at 0x7f4d3ecd19d0>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:47:43.910989 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-7a70bdfb-282b-41df-b7c1-aa206aafce03 tempest-TestVolumeBootPattern-174108509 tempest-TestVolumeBootPattern-174108509-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-363590622" status: 202 len: 0 microversion: 2.1 time: 0.035776 Sep 25 04:47:43.913052 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 538/1146] 10.222.0.25 () {58 vars in 1260 bytes} [Sun Sep 25 04:47:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-363590622 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 04:48:18.433464 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 25 04:48:18.433983 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Sun Sep 25 04:48:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082/os-volume_attachments (ip 10.222.0.25) !!! Sep 25 04:48:18.434868 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_api:SELECT=42 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:48:18.436386 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=1 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:48:18.441999 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-c55e627d-b789-48b5-964f-ed2d46b09979 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:48:18.444098 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-c55e627d-b789-48b5-964f-ed2d46b09979 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:48:18.453542 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c55e627d-b789-48b5-964f-ed2d46b09979 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:48:18.454022 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c55e627d-b789-48b5-964f-ed2d46b09979 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:48:18.454455 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c55e627d-b789-48b5-964f-ed2d46b09979 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:48:18.455239 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c55e627d-b789-48b5-964f-ed2d46b09979 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:48:18.455582 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c55e627d-b789-48b5-964f-ed2d46b09979 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:48:18.456001 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c55e627d-b789-48b5-964f-ed2d46b09979 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:48:18.487971 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-c55e627d-b789-48b5-964f-ed2d46b09979 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.057993 Sep 25 04:48:18.488523 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 609/1147] 10.222.0.25 () {60 vars in 1343 bytes} [Sun Sep 25 04:48:18 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:48:18.553743 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:48:18.554592 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_api:SELECT=4,nova_api:DELETE=1 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:48:18.558957 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-8164fe35-c6ea-4d1a-a56c-df16c2e53cbb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:48:18.559449 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-8164fe35-c6ea-4d1a-a56c-df16c2e53cbb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:48:18.569203 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8164fe35-c6ea-4d1a-a56c-df16c2e53cbb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:48:18.569688 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8164fe35-c6ea-4d1a-a56c-df16c2e53cbb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:48:18.570118 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8164fe35-c6ea-4d1a-a56c-df16c2e53cbb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:48:18.570887 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8164fe35-c6ea-4d1a-a56c-df16c2e53cbb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:48:18.571243 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8164fe35-c6ea-4d1a-a56c-df16c2e53cbb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:48:18.571664 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8164fe35-c6ea-4d1a-a56c-df16c2e53cbb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:48:18.599657 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-8164fe35-c6ea-4d1a-a56c-df16c2e53cbb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Going to try to terminate instance {{(pid=127141) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 04:48:18.673663 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-8164fe35-c6ea-4d1a-a56c-df16c2e53cbb tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 204 len: 0 microversion: 2.20 time: 0.121126 Sep 25 04:48:18.674761 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 539/1148] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Sep 25 04:48:18 2022] DELETE /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 25 04:48:18.684694 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-cf7f1100-d0fc-40f3-921b-8cad5818fb24 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:48:18.686122 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-cf7f1100-d0fc-40f3-921b-8cad5818fb24 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:48:18.692703 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cf7f1100-d0fc-40f3-921b-8cad5818fb24 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:48:18.693213 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cf7f1100-d0fc-40f3-921b-8cad5818fb24 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:48:18.693644 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cf7f1100-d0fc-40f3-921b-8cad5818fb24 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:48:18.694476 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cf7f1100-d0fc-40f3-921b-8cad5818fb24 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:48:18.694936 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cf7f1100-d0fc-40f3-921b-8cad5818fb24 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:48:18.695366 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cf7f1100-d0fc-40f3-921b-8cad5818fb24 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:48:18.825559 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-cf7f1100-d0fc-40f3-921b-8cad5818fb24 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:48:18.833698 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-cf7f1100-d0fc-40f3-921b-8cad5818fb24 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:48:18.835141 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-cf7f1100-d0fc-40f3-921b-8cad5818fb24 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:48:18.836308 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-cf7f1100-d0fc-40f3-921b-8cad5818fb24 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1724 microversion: 2.20 time: 0.157111 Sep 25 04:48:18.836905 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 610/1149] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:48:18 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:48:19.862442 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-3ebab797-2fb5-4f97-8eb9-8ae95cfa933d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:48:19.863250 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-3ebab797-2fb5-4f97-8eb9-8ae95cfa933d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:48:19.869830 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3ebab797-2fb5-4f97-8eb9-8ae95cfa933d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:48:19.870316 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3ebab797-2fb5-4f97-8eb9-8ae95cfa933d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:48:19.870755 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3ebab797-2fb5-4f97-8eb9-8ae95cfa933d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:48:19.871442 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3ebab797-2fb5-4f97-8eb9-8ae95cfa933d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:48:19.871898 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3ebab797-2fb5-4f97-8eb9-8ae95cfa933d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:48:19.872325 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3ebab797-2fb5-4f97-8eb9-8ae95cfa933d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:48:20.011380 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-3ebab797-2fb5-4f97-8eb9-8ae95cfa933d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:48:20.020495 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-3ebab797-2fb5-4f97-8eb9-8ae95cfa933d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:48:20.021989 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-3ebab797-2fb5-4f97-8eb9-8ae95cfa933d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:48:20.023919 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-3ebab797-2fb5-4f97-8eb9-8ae95cfa933d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1724 microversion: 2.20 time: 0.165046 Sep 25 04:48:20.024848 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 540/1150] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:48:19 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:48:21.051006 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-0fe48a31-003a-4088-be54-4faa4f0d13aa tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:48:21.051616 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-0fe48a31-003a-4088-be54-4faa4f0d13aa tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:48:21.058136 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0fe48a31-003a-4088-be54-4faa4f0d13aa tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:48:21.058616 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0fe48a31-003a-4088-be54-4faa4f0d13aa tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:48:21.059051 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0fe48a31-003a-4088-be54-4faa4f0d13aa tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:48:21.059734 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0fe48a31-003a-4088-be54-4faa4f0d13aa tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:48:21.060828 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0fe48a31-003a-4088-be54-4faa4f0d13aa tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:48:21.061564 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0fe48a31-003a-4088-be54-4faa4f0d13aa tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:48:21.198173 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-0fe48a31-003a-4088-be54-4faa4f0d13aa tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:48:21.206443 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-0fe48a31-003a-4088-be54-4faa4f0d13aa tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:48:21.207902 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-0fe48a31-003a-4088-be54-4faa4f0d13aa tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:48:21.209106 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-0fe48a31-003a-4088-be54-4faa4f0d13aa tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1724 microversion: 2.20 time: 0.161955 Sep 25 04:48:21.209663 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 611/1151] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:48:21 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:48:22.235635 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-97fe738c-b080-40c2-9f69-f52c9cebe125 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:48:22.236220 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-97fe738c-b080-40c2-9f69-f52c9cebe125 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:48:22.243708 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-97fe738c-b080-40c2-9f69-f52c9cebe125 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:48:22.244372 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-97fe738c-b080-40c2-9f69-f52c9cebe125 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:48:22.245146 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-97fe738c-b080-40c2-9f69-f52c9cebe125 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:48:22.245838 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-97fe738c-b080-40c2-9f69-f52c9cebe125 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:48:22.246293 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-97fe738c-b080-40c2-9f69-f52c9cebe125 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:48:22.246717 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-97fe738c-b080-40c2-9f69-f52c9cebe125 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:48:22.378497 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-97fe738c-b080-40c2-9f69-f52c9cebe125 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:48:22.386578 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-97fe738c-b080-40c2-9f69-f52c9cebe125 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:48:22.388128 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-97fe738c-b080-40c2-9f69-f52c9cebe125 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:48:22.389928 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-97fe738c-b080-40c2-9f69-f52c9cebe125 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1724 microversion: 2.20 time: 0.158619 Sep 25 04:48:22.390476 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 541/1152] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:48:22 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:48:23.415179 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-e4de3727-b556-46f7-99a4-493a34d63ae2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:48:23.415798 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-e4de3727-b556-46f7-99a4-493a34d63ae2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:48:23.422588 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e4de3727-b556-46f7-99a4-493a34d63ae2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:48:23.423072 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e4de3727-b556-46f7-99a4-493a34d63ae2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:48:23.423512 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e4de3727-b556-46f7-99a4-493a34d63ae2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:48:23.424203 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e4de3727-b556-46f7-99a4-493a34d63ae2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:48:23.424790 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e4de3727-b556-46f7-99a4-493a34d63ae2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:48:23.425523 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e4de3727-b556-46f7-99a4-493a34d63ae2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:48:23.559591 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-e4de3727-b556-46f7-99a4-493a34d63ae2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:48:23.567806 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-e4de3727-b556-46f7-99a4-493a34d63ae2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:48:23.569305 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-e4de3727-b556-46f7-99a4-493a34d63ae2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:48:23.570467 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-e4de3727-b556-46f7-99a4-493a34d63ae2 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1724 microversion: 2.20 time: 0.159290 Sep 25 04:48:23.571022 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 612/1153] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:48:23 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:48:24.600620 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-788d898f-3bb8-4655-a0f4-07efd8021c69 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:48:24.600620 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-788d898f-3bb8-4655-a0f4-07efd8021c69 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:48:24.604132 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-788d898f-3bb8-4655-a0f4-07efd8021c69 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:48:24.604670 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-788d898f-3bb8-4655-a0f4-07efd8021c69 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:48:24.605128 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-788d898f-3bb8-4655-a0f4-07efd8021c69 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:48:24.605824 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-788d898f-3bb8-4655-a0f4-07efd8021c69 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:48:24.606310 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-788d898f-3bb8-4655-a0f4-07efd8021c69 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:48:24.607625 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-788d898f-3bb8-4655-a0f4-07efd8021c69 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:48:24.676460 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-788d898f-3bb8-4655-a0f4-07efd8021c69 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:48:24.684509 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-788d898f-3bb8-4655-a0f4-07efd8021c69 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:48:24.686396 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-788d898f-3bb8-4655-a0f4-07efd8021c69 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:48:24.687559 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-788d898f-3bb8-4655-a0f4-07efd8021c69 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1657 microversion: 2.20 time: 0.095331 Sep 25 04:48:24.688111 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 542/1154] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:48:24 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1657 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:48:24.859110 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-58d8094b-a945-473c-812f-640e990e32fb req-1c45e594-7bf6-4dc0-9d6a-87ef970171af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ae04d96-b4dc-4acf-9f79-4f6644c1a082", "name": "network-vif-deleted", "tag": "67e59d38-b12f-4f51-bb79-591d93062336"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:48:24.871878 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-58d8094b-a945-473c-812f-640e990e32fb req-1c45e594-7bf6-4dc0-9d6a-87ef970171af service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:48:24.872477 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-58d8094b-a945-473c-812f-640e990e32fb req-1c45e594-7bf6-4dc0-9d6a-87ef970171af service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:48:24.873151 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-58d8094b-a945-473c-812f-640e990e32fb req-1c45e594-7bf6-4dc0-9d6a-87ef970171af service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:48:24.885351 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-58d8094b-a945-473c-812f-640e990e32fb req-1c45e594-7bf6-4dc0-9d6a-87ef970171af service nova] Creating event network-vif-deleted:67e59d38-b12f-4f51-bb79-591d93062336 for instance 8ae04d96-b4dc-4acf-9f79-4f6644c1a082 on hv-cinder-85535 Sep 25 04:48:24.895154 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-58d8094b-a945-473c-812f-640e990e32fb req-1c45e594-7bf6-4dc0-9d6a-87ef970171af service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040704 Sep 25 04:48:24.896361 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 613/1155] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:48:25.712999 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-b41cc9d9-0242-4a5b-b0cb-85d8d23cd54a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:48:25.713643 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-b41cc9d9-0242-4a5b-b0cb-85d8d23cd54a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:48:25.721138 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b41cc9d9-0242-4a5b-b0cb-85d8d23cd54a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:48:25.721632 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b41cc9d9-0242-4a5b-b0cb-85d8d23cd54a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:48:25.722077 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b41cc9d9-0242-4a5b-b0cb-85d8d23cd54a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:48:25.722785 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b41cc9d9-0242-4a5b-b0cb-85d8d23cd54a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:48:25.723241 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b41cc9d9-0242-4a5b-b0cb-85d8d23cd54a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:48:25.723671 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b41cc9d9-0242-4a5b-b0cb-85d8d23cd54a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:48:25.791461 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-b41cc9d9-0242-4a5b-b0cb-85d8d23cd54a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:48:25.800404 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-b41cc9d9-0242-4a5b-b0cb-85d8d23cd54a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:48:25.801899 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-b41cc9d9-0242-4a5b-b0cb-85d8d23cd54a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:48:25.803070 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-b41cc9d9-0242-4a5b-b0cb-85d8d23cd54a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1657 microversion: 2.20 time: 0.094704 Sep 25 04:48:25.803623 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 543/1156] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:48:25 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1657 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:48:26.830310 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-2c987db5-e68f-43d6-a5b8-034c403f79fd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:48:26.830924 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-2c987db5-e68f-43d6-a5b8-034c403f79fd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:48:26.837156 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2c987db5-e68f-43d6-a5b8-034c403f79fd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:48:26.837639 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2c987db5-e68f-43d6-a5b8-034c403f79fd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:48:26.838074 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2c987db5-e68f-43d6-a5b8-034c403f79fd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:48:26.838760 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2c987db5-e68f-43d6-a5b8-034c403f79fd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:48:26.839475 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2c987db5-e68f-43d6-a5b8-034c403f79fd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:48:26.839900 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2c987db5-e68f-43d6-a5b8-034c403f79fd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:48:26.904800 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-2c987db5-e68f-43d6-a5b8-034c403f79fd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:48:26.913407 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-2c987db5-e68f-43d6-a5b8-034c403f79fd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:48:26.914843 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-2c987db5-e68f-43d6-a5b8-034c403f79fd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:48:26.915967 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-2c987db5-e68f-43d6-a5b8-034c403f79fd tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1367 microversion: 2.20 time: 0.090926 Sep 25 04:48:26.916522 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 614/1157] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:48:26 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:48:27.942393 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-0cedd66b-f17b-4a59-acd5-45bcc386b914 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:48:27.942991 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-0cedd66b-f17b-4a59-acd5-45bcc386b914 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:48:27.949412 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0cedd66b-f17b-4a59-acd5-45bcc386b914 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:48:27.949930 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0cedd66b-f17b-4a59-acd5-45bcc386b914 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:48:27.950366 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0cedd66b-f17b-4a59-acd5-45bcc386b914 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:48:27.951058 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0cedd66b-f17b-4a59-acd5-45bcc386b914 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:48:27.951514 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0cedd66b-f17b-4a59-acd5-45bcc386b914 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:48:27.952145 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-0cedd66b-f17b-4a59-acd5-45bcc386b914 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:48:28.012919 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-0cedd66b-f17b-4a59-acd5-45bcc386b914 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:48:28.021261 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-0cedd66b-f17b-4a59-acd5-45bcc386b914 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:48:28.022705 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-0cedd66b-f17b-4a59-acd5-45bcc386b914 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:48:28.023838 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-0cedd66b-f17b-4a59-acd5-45bcc386b914 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1367 microversion: 2.20 time: 0.085422 Sep 25 04:48:28.024391 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 544/1158] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:48:27 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 04:48:29.047790 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-808630a1-cd22-4783-860e-6380857f511d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:48:29.048482 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-808630a1-cd22-4783-860e-6380857f511d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:48:29.055188 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-808630a1-cd22-4783-860e-6380857f511d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:48:29.055704 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-808630a1-cd22-4783-860e-6380857f511d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:48:29.056356 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-808630a1-cd22-4783-860e-6380857f511d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:48:29.057068 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-808630a1-cd22-4783-860e-6380857f511d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:48:29.057519 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-808630a1-cd22-4783-860e-6380857f511d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:48:29.057943 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-808630a1-cd22-4783-860e-6380857f511d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:48:29.093168 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-808630a1-cd22-4783-860e-6380857f511d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:48:29.093852 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-808630a1-cd22-4783-860e-6380857f511d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:48:29.094480 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-808630a1-cd22-4783-860e-6380857f511d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:48:29.094923 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.objects.instance [None req-808630a1-cd22-4783-860e-6380857f511d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lazy-loading 'fault' on Instance uuid 8ae04d96-b4dc-4acf-9f79-4f6644c1a082 {{(pid=127142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 04:48:29.135914 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-808630a1-cd22-4783-860e-6380857f511d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:48:29.145494 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-808630a1-cd22-4783-860e-6380857f511d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:48:29.146787 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-808630a1-cd22-4783-860e-6380857f511d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7354aa144df4ad69cd7d12f11b1d8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ac515b97884375b3e85c6e54de81bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:48:29.147988 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-808630a1-cd22-4783-860e-6380857f511d tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 200 len: 1372 microversion: 2.20 time: 0.104531 Sep 25 04:48:29.148552 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 615/1159] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:48:29 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 1372 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 04:48:30.174087 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-8e6b3706-4b44-4a68-bbe1-a0b7d537c3a1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:48:30.174751 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-8e6b3706-4b44-4a68-bbe1-a0b7d537c3a1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:48:30.181485 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8e6b3706-4b44-4a68-bbe1-a0b7d537c3a1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:48:30.181974 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8e6b3706-4b44-4a68-bbe1-a0b7d537c3a1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:48:30.182422 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8e6b3706-4b44-4a68-bbe1-a0b7d537c3a1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:48:30.183180 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8e6b3706-4b44-4a68-bbe1-a0b7d537c3a1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:48:30.183638 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8e6b3706-4b44-4a68-bbe1-a0b7d537c3a1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:48:30.184067 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8e6b3706-4b44-4a68-bbe1-a0b7d537c3a1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:48:30.198802 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.wsgi [None req-8e6b3706-4b44-4a68-bbe1-a0b7d537c3a1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] HTTP exception thrown: Instance 8ae04d96-b4dc-4acf-9f79-4f6644c1a082 could not be found. Sep 25 04:48:30.200530 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-8e6b3706-4b44-4a68-bbe1-a0b7d537c3a1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Request method failure captured: Sep 25 04:48:30.200530 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: request: GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 HTTP/1.1 Sep 25 04:48:30.200530 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept: application/json Sep 25 04:48:30.200530 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept-Encoding: identity Sep 25 04:48:30.200530 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Connection: close Sep 25 04:48:30.200530 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Length: 0 Sep 25 04:48:30.200530 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Type: application/json Sep 25 04:48:30.200530 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Host: 10.222.0.25 Sep 25 04:48:30.200530 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Openstack-System-Scope: None Sep 25 04:48:30.200530 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: User-Agent: python-urllib3/1.26.12 Sep 25 04:48:30.200530 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Auth-Token: gAAAAABjL9qz254B1IcdEE-jUCUffbcyaH8oenu0AtiZ85BV4soEbolOg6vHesZhC66QsiGG84RhbrH-yq9-yj99hy_H051ERXQnYAv_UhbU3XhO2au4Jq1wfmlbcf13L2NY-T_4qwjLr8S197h_Y80p8jUjAA0HxulUK32OmVCk6AfdHbjudME Sep 25 04:48:30.200530 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Id: None Sep 25 04:48:30.200530 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Name: None Sep 25 04:48:30.200530 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Identity-Status: Confirmed Sep 25 04:48:30.200530 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Is-Admin-Project: True Sep 25 04:48:30.200530 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Openstack-Nova-Api-Version: 2.20 Sep 25 04:48:30.200530 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Id: default Sep 25 04:48:30.200530 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Name: Default Sep 25 04:48:30.200530 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Id: a2ac515b97884375b3e85c6e54de81bc Sep 25 04:48:30.200530 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1149609715 Sep 25 04:48:30.200530 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Role: reader,member Sep 25 04:48:30.200530 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Roles: reader,member Sep 25 04:48:30.202438 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a2ac515b97884375b3e85c6e54de81bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2ac515b97884375b3e85c6e54de81bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2ac515b97884375b3e85c6e54de81bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a2ac515b97884375b3e85c6e54de81bc"}]}] Sep 25 04:48:30.202438 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1149609715 Sep 25 04:48:30.202438 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Id: a2ac515b97884375b3e85c6e54de81bc Sep 25 04:48:30.202438 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1149609715 Sep 25 04:48:30.202438 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User: tempest-AttachVolumeShelveTestJSON-1149609715-project Sep 25 04:48:30.202438 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Id: default Sep 25 04:48:30.202438 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Name: Default Sep 25 04:48:30.202438 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Id: e7354aa144df4ad69cd7d12f11b1d8a5 Sep 25 04:48:30.202438 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1149609715-project Sep 25 04:48:30.202438 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: method: > Sep 25 04:48:30.202438 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: exception: Instance 8ae04d96-b4dc-4acf-9f79-4f6644c1a082 could not be found. Sep 25 04:48:30.202438 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: action_args: {'id': '8ae04d96-b4dc-4acf-9f79-4f6644c1a082'} Sep 25 04:48:30.204227 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:48:30.204227 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:48:30.204227 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:48:30.204227 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:48:30.204227 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:48:30.204227 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:48:30.204227 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:48:30.204227 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:48:30.204227 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:48:30.204227 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:48:30.204227 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ae04d96-b4dc-4acf-9f79-4f6644c1a082 could not be found. Sep 25 04:48:30.204227 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:48:30.204227 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:48:30.204227 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:48:30.204227 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:48:30.204227 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:48:30.204227 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:48:30.204227 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:48:30.204227 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:48:30.204227 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:48:30.205951 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:48:30.205951 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 04:48:30.205951 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 04:48:30.205951 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:48:30.205951 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:48:30.205951 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:48:30.205951 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:48:30.205951 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ae04d96-b4dc-4acf-9f79-4f6644c1a082 could not be found. Sep 25 04:48:30.205951 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:48:30.205951 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:48:30.205951 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:48:30.205951 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:48:30.205951 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:48:30.205951 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:48:30.205951 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:48:30.205951 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:48:30.205951 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ae04d96-b4dc-4acf-9f79-4f6644c1a082 could not be found. Sep 25 04:48:30.205951 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:48:30.207405 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-8e6b3706-4b44-4a68-bbe1-a0b7d537c3a1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Returning 404 to user: Instance 8ae04d96-b4dc-4acf-9f79-4f6644c1a082 could not be found. {{(pid=127141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:48:30.207405 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-8e6b3706-4b44-4a68-bbe1-a0b7d537c3a1 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 404 len: 111 microversion: 2.20 time: 0.032239 Sep 25 04:48:30.207405 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 545/1160] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:48:30 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 25 04:48:30.213258 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-265206d1-f8eb-463b-aaff-7a43f81c9474 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '.version_select at 0x7f4d3eb5ef70>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:48:30.236510 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-265206d1-f8eb-463b-aaff-7a43f81c9474 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1995613388" status: 204 len: 0 microversion: 2.20 time: 0.028003 Sep 25 04:48:30.237334 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 616/1161] 10.222.0.25 () {60 vars in 1262 bytes} [Sun Sep 25 04:48:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1995613388 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 25 04:48:32.036217 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-2b865952-be3a-42ef-b178-9ce7016aee3b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:48:32.036751 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-2b865952-be3a-42ef-b178-9ce7016aee3b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:48:32.043129 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2b865952-be3a-42ef-b178-9ce7016aee3b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:48:32.043607 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2b865952-be3a-42ef-b178-9ce7016aee3b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:48:32.044043 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2b865952-be3a-42ef-b178-9ce7016aee3b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:48:32.044822 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2b865952-be3a-42ef-b178-9ce7016aee3b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:48:32.045275 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2b865952-be3a-42ef-b178-9ce7016aee3b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:48:32.045697 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2b865952-be3a-42ef-b178-9ce7016aee3b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:48:32.059100 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.wsgi [None req-2b865952-be3a-42ef-b178-9ce7016aee3b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] HTTP exception thrown: Instance 8ae04d96-b4dc-4acf-9f79-4f6644c1a082 could not be found. Sep 25 04:48:32.060626 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-2b865952-be3a-42ef-b178-9ce7016aee3b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Request method failure captured: Sep 25 04:48:32.060626 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: request: DELETE /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 HTTP/1.1 Sep 25 04:48:32.060626 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept: application/json Sep 25 04:48:32.060626 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept-Encoding: identity Sep 25 04:48:32.060626 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Connection: close Sep 25 04:48:32.060626 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Length: 0 Sep 25 04:48:32.060626 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Type: application/json Sep 25 04:48:32.060626 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Host: 10.222.0.25 Sep 25 04:48:32.060626 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Openstack-System-Scope: None Sep 25 04:48:32.060626 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: User-Agent: python-urllib3/1.26.12 Sep 25 04:48:32.060626 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Auth-Token: gAAAAABjL9qz254B1IcdEE-jUCUffbcyaH8oenu0AtiZ85BV4soEbolOg6vHesZhC66QsiGG84RhbrH-yq9-yj99hy_H051ERXQnYAv_UhbU3XhO2au4Jq1wfmlbcf13L2NY-T_4qwjLr8S197h_Y80p8jUjAA0HxulUK32OmVCk6AfdHbjudME Sep 25 04:48:32.060626 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Id: None Sep 25 04:48:32.060626 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Name: None Sep 25 04:48:32.060626 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Identity-Status: Confirmed Sep 25 04:48:32.060626 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Is-Admin-Project: True Sep 25 04:48:32.060626 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Openstack-Nova-Api-Version: 2.20 Sep 25 04:48:32.060626 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Id: default Sep 25 04:48:32.060626 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Name: Default Sep 25 04:48:32.060626 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Id: a2ac515b97884375b3e85c6e54de81bc Sep 25 04:48:32.060626 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1149609715 Sep 25 04:48:32.060626 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Role: reader,member Sep 25 04:48:32.060626 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Roles: reader,member Sep 25 04:48:32.062955 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a2ac515b97884375b3e85c6e54de81bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2ac515b97884375b3e85c6e54de81bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2ac515b97884375b3e85c6e54de81bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a2ac515b97884375b3e85c6e54de81bc"}]}] Sep 25 04:48:32.062955 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1149609715 Sep 25 04:48:32.062955 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Id: a2ac515b97884375b3e85c6e54de81bc Sep 25 04:48:32.062955 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1149609715 Sep 25 04:48:32.062955 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User: tempest-AttachVolumeShelveTestJSON-1149609715-project Sep 25 04:48:32.062955 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Id: default Sep 25 04:48:32.062955 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Name: Default Sep 25 04:48:32.062955 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Id: e7354aa144df4ad69cd7d12f11b1d8a5 Sep 25 04:48:32.062955 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1149609715-project Sep 25 04:48:32.062955 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: method: > Sep 25 04:48:32.062955 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: exception: Instance 8ae04d96-b4dc-4acf-9f79-4f6644c1a082 could not be found. Sep 25 04:48:32.062955 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: action_args: {'id': '8ae04d96-b4dc-4acf-9f79-4f6644c1a082'} Sep 25 04:48:32.063933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:48:32.063933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:48:32.063933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:48:32.063933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:48:32.063933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:48:32.063933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:48:32.063933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:48:32.063933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:48:32.063933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:48:32.063933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:48:32.063933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ae04d96-b4dc-4acf-9f79-4f6644c1a082 could not be found. Sep 25 04:48:32.063933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:48:32.063933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:48:32.063933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:48:32.063933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:48:32.063933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:48:32.063933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:48:32.063933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:48:32.063933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:48:32.063933 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:48:32.065512 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:48:32.065512 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 04:48:32.065512 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 04:48:32.065512 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 04:48:32.065512 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 04:48:32.065512 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:48:32.065512 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:48:32.065512 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:48:32.065512 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:48:32.065512 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ae04d96-b4dc-4acf-9f79-4f6644c1a082 could not be found. Sep 25 04:48:32.065512 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:48:32.065512 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:48:32.065512 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:48:32.065512 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:48:32.065512 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:48:32.065512 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:48:32.065512 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:48:32.065512 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:48:32.065512 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ae04d96-b4dc-4acf-9f79-4f6644c1a082 could not be found. Sep 25 04:48:32.065512 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:48:32.067076 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-2b865952-be3a-42ef-b178-9ce7016aee3b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Returning 404 to user: Instance 8ae04d96-b4dc-4acf-9f79-4f6644c1a082 could not be found. {{(pid=127141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:48:32.067076 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-2b865952-be3a-42ef-b178-9ce7016aee3b tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 404 len: 111 microversion: 2.20 time: 0.029977 Sep 25 04:48:32.067076 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 546/1162] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Sep 25 04:48:32 2022] DELETE /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 25 04:48:32.071745 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-3fd496d7-d321-4f44-9b29-77173221555a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:48:32.072388 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-3fd496d7-d321-4f44-9b29-77173221555a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: 8ae04d96-b4dc-4acf-9f79-4f6644c1a082] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:48:32.081610 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3fd496d7-d321-4f44-9b29-77173221555a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:48:32.082097 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3fd496d7-d321-4f44-9b29-77173221555a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:48:32.082538 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3fd496d7-d321-4f44-9b29-77173221555a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:48:32.083227 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3fd496d7-d321-4f44-9b29-77173221555a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:48:32.083682 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3fd496d7-d321-4f44-9b29-77173221555a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:48:32.084110 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-3fd496d7-d321-4f44-9b29-77173221555a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:48:32.097336 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.wsgi [None req-3fd496d7-d321-4f44-9b29-77173221555a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] HTTP exception thrown: Instance 8ae04d96-b4dc-4acf-9f79-4f6644c1a082 could not be found. Sep 25 04:48:32.098970 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-3fd496d7-d321-4f44-9b29-77173221555a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Request method failure captured: Sep 25 04:48:32.098970 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: request: GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 HTTP/1.1 Sep 25 04:48:32.098970 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept: application/json Sep 25 04:48:32.098970 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept-Encoding: identity Sep 25 04:48:32.098970 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Connection: close Sep 25 04:48:32.098970 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Length: 0 Sep 25 04:48:32.098970 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Type: application/json Sep 25 04:48:32.098970 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Host: 10.222.0.25 Sep 25 04:48:32.098970 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Openstack-System-Scope: None Sep 25 04:48:32.098970 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: User-Agent: python-urllib3/1.26.12 Sep 25 04:48:32.098970 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Auth-Token: gAAAAABjL9qz254B1IcdEE-jUCUffbcyaH8oenu0AtiZ85BV4soEbolOg6vHesZhC66QsiGG84RhbrH-yq9-yj99hy_H051ERXQnYAv_UhbU3XhO2au4Jq1wfmlbcf13L2NY-T_4qwjLr8S197h_Y80p8jUjAA0HxulUK32OmVCk6AfdHbjudME Sep 25 04:48:32.098970 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Id: None Sep 25 04:48:32.098970 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Name: None Sep 25 04:48:32.098970 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Identity-Status: Confirmed Sep 25 04:48:32.098970 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Is-Admin-Project: True Sep 25 04:48:32.098970 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Openstack-Nova-Api-Version: 2.20 Sep 25 04:48:32.098970 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Id: default Sep 25 04:48:32.098970 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Name: Default Sep 25 04:48:32.098970 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Id: a2ac515b97884375b3e85c6e54de81bc Sep 25 04:48:32.098970 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1149609715 Sep 25 04:48:32.098970 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Role: reader,member Sep 25 04:48:32.098970 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Roles: reader,member Sep 25 04:48:32.100839 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a2ac515b97884375b3e85c6e54de81bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2ac515b97884375b3e85c6e54de81bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2ac515b97884375b3e85c6e54de81bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a2ac515b97884375b3e85c6e54de81bc"}]}] Sep 25 04:48:32.100839 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1149609715 Sep 25 04:48:32.100839 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Id: a2ac515b97884375b3e85c6e54de81bc Sep 25 04:48:32.100839 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1149609715 Sep 25 04:48:32.100839 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User: tempest-AttachVolumeShelveTestJSON-1149609715-project Sep 25 04:48:32.100839 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Id: default Sep 25 04:48:32.100839 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Name: Default Sep 25 04:48:32.100839 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Id: e7354aa144df4ad69cd7d12f11b1d8a5 Sep 25 04:48:32.100839 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1149609715-project Sep 25 04:48:32.100839 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: method: > Sep 25 04:48:32.100839 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: exception: Instance 8ae04d96-b4dc-4acf-9f79-4f6644c1a082 could not be found. Sep 25 04:48:32.100839 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: action_args: {'id': '8ae04d96-b4dc-4acf-9f79-4f6644c1a082'} Sep 25 04:48:32.101805 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:48:32.101805 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:48:32.101805 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:48:32.101805 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:48:32.101805 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:48:32.101805 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:48:32.101805 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:48:32.101805 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:48:32.101805 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:48:32.101805 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:48:32.101805 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ae04d96-b4dc-4acf-9f79-4f6644c1a082 could not be found. Sep 25 04:48:32.101805 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:48:32.101805 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:48:32.101805 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:48:32.101805 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:48:32.101805 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:48:32.101805 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:48:32.101805 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:48:32.101805 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:48:32.101805 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:48:32.103349 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:48:32.103349 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 04:48:32.103349 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 04:48:32.103349 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:48:32.103349 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:48:32.103349 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:48:32.103349 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:48:32.103349 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ae04d96-b4dc-4acf-9f79-4f6644c1a082 could not be found. Sep 25 04:48:32.103349 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:48:32.103349 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:48:32.103349 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:48:32.103349 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:48:32.103349 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:48:32.103349 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:48:32.103349 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:48:32.103349 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:48:32.103349 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ae04d96-b4dc-4acf-9f79-4f6644c1a082 could not be found. Sep 25 04:48:32.103349 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:48:32.104757 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-3fd496d7-d321-4f44-9b29-77173221555a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Returning 404 to user: Instance 8ae04d96-b4dc-4acf-9f79-4f6644c1a082 could not be found. {{(pid=127142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:48:32.104757 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-3fd496d7-d321-4f44-9b29-77173221555a tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082" status: 404 len: 111 microversion: 2.20 time: 0.033122 Sep 25 04:48:32.104757 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 617/1163] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:48:32 2022] GET /compute/v2.1/servers/8ae04d96-b4dc-4acf-9f79-4f6644c1a082 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 25 04:48:36.409004 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-49dc86ac-2fc6-4881-899c-f74836863e96 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:48:36.409004 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-49dc86ac-2fc6-4881-899c-f74836863e96 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:48:36.410978 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-49dc86ac-2fc6-4881-899c-f74836863e96 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:48:36.411147 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-49dc86ac-2fc6-4881-899c-f74836863e96 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:48:36.411570 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-49dc86ac-2fc6-4881-899c-f74836863e96 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:48:36.413830 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-49dc86ac-2fc6-4881-899c-f74836863e96 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:48:36.414745 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-49dc86ac-2fc6-4881-899c-f74836863e96 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:48:36.415440 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-49dc86ac-2fc6-4881-899c-f74836863e96 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:48:36.432823 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.wsgi [None req-49dc86ac-2fc6-4881-899c-f74836863e96 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] HTTP exception thrown: Instance c9e99419-ae76-4d84-9e7a-d0a31530ea14 could not be found. Sep 25 04:48:36.434388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-49dc86ac-2fc6-4881-899c-f74836863e96 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Request method failure captured: Sep 25 04:48:36.434388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: request: DELETE /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 HTTP/1.1 Sep 25 04:48:36.434388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept: application/json Sep 25 04:48:36.434388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Accept-Encoding: identity Sep 25 04:48:36.434388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Connection: close Sep 25 04:48:36.434388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Length: 0 Sep 25 04:48:36.434388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Content-Type: application/json Sep 25 04:48:36.434388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Host: 10.222.0.25 Sep 25 04:48:36.434388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Openstack-System-Scope: None Sep 25 04:48:36.434388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: User-Agent: python-urllib3/1.26.12 Sep 25 04:48:36.434388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Auth-Token: gAAAAABjL9qz254B1IcdEE-jUCUffbcyaH8oenu0AtiZ85BV4soEbolOg6vHesZhC66QsiGG84RhbrH-yq9-yj99hy_H051ERXQnYAv_UhbU3XhO2au4Jq1wfmlbcf13L2NY-T_4qwjLr8S197h_Y80p8jUjAA0HxulUK32OmVCk6AfdHbjudME Sep 25 04:48:36.434388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Id: None Sep 25 04:48:36.434388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Domain-Name: None Sep 25 04:48:36.434388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Identity-Status: Confirmed Sep 25 04:48:36.434388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Is-Admin-Project: True Sep 25 04:48:36.434388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Openstack-Nova-Api-Version: 2.20 Sep 25 04:48:36.434388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Id: default Sep 25 04:48:36.434388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Domain-Name: Default Sep 25 04:48:36.434388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Id: a2ac515b97884375b3e85c6e54de81bc Sep 25 04:48:36.434388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1149609715 Sep 25 04:48:36.434388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Role: reader,member Sep 25 04:48:36.434388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Roles: reader,member Sep 25 04:48:36.435867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a2ac515b97884375b3e85c6e54de81bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2ac515b97884375b3e85c6e54de81bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2ac515b97884375b3e85c6e54de81bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a2ac515b97884375b3e85c6e54de81bc"}]}] Sep 25 04:48:36.435867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1149609715 Sep 25 04:48:36.435867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Id: a2ac515b97884375b3e85c6e54de81bc Sep 25 04:48:36.435867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1149609715 Sep 25 04:48:36.435867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User: tempest-AttachVolumeShelveTestJSON-1149609715-project Sep 25 04:48:36.435867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Id: default Sep 25 04:48:36.435867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Domain-Name: Default Sep 25 04:48:36.435867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Id: e7354aa144df4ad69cd7d12f11b1d8a5 Sep 25 04:48:36.435867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1149609715-project Sep 25 04:48:36.435867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: method: > Sep 25 04:48:36.435867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: exception: Instance c9e99419-ae76-4d84-9e7a-d0a31530ea14 could not be found. Sep 25 04:48:36.435867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: action_args: {'id': 'c9e99419-ae76-4d84-9e7a-d0a31530ea14'} Sep 25 04:48:36.437031 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:48:36.437031 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:48:36.437031 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:48:36.437031 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:48:36.437031 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:48:36.437031 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:48:36.437031 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:48:36.437031 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:48:36.437031 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:48:36.437031 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:48:36.437031 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9e99419-ae76-4d84-9e7a-d0a31530ea14 could not be found. Sep 25 04:48:36.437031 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:48:36.437031 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:48:36.437031 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:48:36.437031 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:48:36.437031 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:48:36.437031 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:48:36.437031 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:48:36.437031 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:48:36.437031 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:48:36.438613 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:48:36.438613 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 04:48:36.438613 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 04:48:36.438613 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 04:48:36.438613 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 04:48:36.438613 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:48:36.438613 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:48:36.438613 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:48:36.438613 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:48:36.438613 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9e99419-ae76-4d84-9e7a-d0a31530ea14 could not be found. Sep 25 04:48:36.438613 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:48:36.438613 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:48:36.438613 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:48:36.438613 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:48:36.438613 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:48:36.438613 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:48:36.438613 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:48:36.438613 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:48:36.438613 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9e99419-ae76-4d84-9e7a-d0a31530ea14 could not be found. Sep 25 04:48:36.438613 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: ERROR nova.api.openstack.wsgi Sep 25 04:48:36.439951 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-49dc86ac-2fc6-4881-899c-f74836863e96 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Returning 404 to user: Instance c9e99419-ae76-4d84-9e7a-d0a31530ea14 could not be found. {{(pid=127141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:48:36.439951 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-49dc86ac-2fc6-4881-899c-f74836863e96 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 404 len: 111 microversion: 2.20 time: 0.037745 Sep 25 04:48:36.439951 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 547/1164] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Sep 25 04:48:36 2022] DELETE /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 25 04:48:36.445599 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-06b787cd-c0dd-47c6-b573-0cde38565f57 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:48:36.446137 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-06b787cd-c0dd-47c6-b573-0cde38565f57 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] [instance: c9e99419-ae76-4d84-9e7a-d0a31530ea14] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:48:36.453275 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-06b787cd-c0dd-47c6-b573-0cde38565f57 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:48:36.453771 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-06b787cd-c0dd-47c6-b573-0cde38565f57 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:48:36.454215 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-06b787cd-c0dd-47c6-b573-0cde38565f57 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:48:36.454927 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-06b787cd-c0dd-47c6-b573-0cde38565f57 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:48:36.455382 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-06b787cd-c0dd-47c6-b573-0cde38565f57 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:48:36.455812 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-06b787cd-c0dd-47c6-b573-0cde38565f57 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:48:36.484911 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.wsgi [None req-06b787cd-c0dd-47c6-b573-0cde38565f57 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] HTTP exception thrown: Instance c9e99419-ae76-4d84-9e7a-d0a31530ea14 could not be found. Sep 25 04:48:36.486506 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-06b787cd-c0dd-47c6-b573-0cde38565f57 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Request method failure captured: Sep 25 04:48:36.486506 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: request: GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 HTTP/1.1 Sep 25 04:48:36.486506 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept: application/json Sep 25 04:48:36.486506 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept-Encoding: identity Sep 25 04:48:36.486506 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Connection: close Sep 25 04:48:36.486506 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Length: 0 Sep 25 04:48:36.486506 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Type: application/json Sep 25 04:48:36.486506 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Host: 10.222.0.25 Sep 25 04:48:36.486506 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Openstack-System-Scope: None Sep 25 04:48:36.486506 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: User-Agent: python-urllib3/1.26.12 Sep 25 04:48:36.486506 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Auth-Token: gAAAAABjL9qz254B1IcdEE-jUCUffbcyaH8oenu0AtiZ85BV4soEbolOg6vHesZhC66QsiGG84RhbrH-yq9-yj99hy_H051ERXQnYAv_UhbU3XhO2au4Jq1wfmlbcf13L2NY-T_4qwjLr8S197h_Y80p8jUjAA0HxulUK32OmVCk6AfdHbjudME Sep 25 04:48:36.486506 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Id: None Sep 25 04:48:36.486506 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Name: None Sep 25 04:48:36.486506 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Identity-Status: Confirmed Sep 25 04:48:36.486506 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Is-Admin-Project: True Sep 25 04:48:36.486506 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Openstack-Nova-Api-Version: 2.20 Sep 25 04:48:36.486506 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Id: default Sep 25 04:48:36.486506 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Name: Default Sep 25 04:48:36.486506 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Id: a2ac515b97884375b3e85c6e54de81bc Sep 25 04:48:36.486506 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1149609715 Sep 25 04:48:36.486506 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Role: reader,member Sep 25 04:48:36.486506 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Roles: reader,member Sep 25 04:48:36.488025 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a2ac515b97884375b3e85c6e54de81bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2ac515b97884375b3e85c6e54de81bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2ac515b97884375b3e85c6e54de81bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a2ac515b97884375b3e85c6e54de81bc"}]}] Sep 25 04:48:36.488025 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1149609715 Sep 25 04:48:36.488025 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Id: a2ac515b97884375b3e85c6e54de81bc Sep 25 04:48:36.488025 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1149609715 Sep 25 04:48:36.488025 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User: tempest-AttachVolumeShelveTestJSON-1149609715-project Sep 25 04:48:36.488025 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Id: default Sep 25 04:48:36.488025 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Name: Default Sep 25 04:48:36.488025 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Id: e7354aa144df4ad69cd7d12f11b1d8a5 Sep 25 04:48:36.488025 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1149609715-project Sep 25 04:48:36.488025 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: method: > Sep 25 04:48:36.488025 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: exception: Instance c9e99419-ae76-4d84-9e7a-d0a31530ea14 could not be found. Sep 25 04:48:36.488025 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: action_args: {'id': 'c9e99419-ae76-4d84-9e7a-d0a31530ea14'} Sep 25 04:48:36.488868 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:48:36.488868 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:48:36.488868 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:48:36.488868 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:48:36.488868 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:48:36.488868 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:48:36.488868 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:48:36.488868 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:48:36.488868 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:48:36.488868 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:48:36.488868 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9e99419-ae76-4d84-9e7a-d0a31530ea14 could not be found. Sep 25 04:48:36.488868 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:48:36.488868 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:48:36.488868 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:48:36.488868 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:48:36.488868 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:48:36.488868 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:48:36.488868 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:48:36.488868 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:48:36.488868 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:48:36.490196 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:48:36.490196 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 04:48:36.490196 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 04:48:36.490196 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:48:36.490196 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:48:36.490196 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:48:36.490196 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:48:36.490196 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9e99419-ae76-4d84-9e7a-d0a31530ea14 could not be found. Sep 25 04:48:36.490196 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:48:36.490196 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:48:36.490196 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:48:36.490196 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:48:36.490196 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:48:36.490196 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:48:36.490196 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:48:36.490196 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:48:36.490196 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9e99419-ae76-4d84-9e7a-d0a31530ea14 could not be found. Sep 25 04:48:36.490196 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:48:36.491373 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-06b787cd-c0dd-47c6-b573-0cde38565f57 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] Returning 404 to user: Instance c9e99419-ae76-4d84-9e7a-d0a31530ea14 could not be found. {{(pid=127142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:48:36.491373 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-06b787cd-c0dd-47c6-b573-0cde38565f57 tempest-AttachVolumeShelveTestJSON-1149609715 tempest-AttachVolumeShelveTestJSON-1149609715-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14" status: 404 len: 111 microversion: 2.20 time: 0.046808 Sep 25 04:48:36.491373 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 618/1165] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Sep 25 04:48:36 2022] GET /compute/v2.1/servers/c9e99419-ae76-4d84-9e7a-d0a31530ea14 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 25 04:48:52.309975 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:48:52.310962 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:48:52.511940 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-389be3c3-5ba8-45cd-bbe0-c6c9082eab40 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Action: 'create', calling method: .version_select at 0x7f4d3ed16f70>, body: {"keypair": {"name": "tempest-TestShelveInstance-1260319028", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFnCUf0aeM2C8+s4eB9KLmhyTeIGg0Mx/3T7HSyrVU+vNBzZbsFV1ZT6TwSt1LXhhpEg/Dig7fjq+0TN8dXDOb7eQ2pU66rmb9rWc9zc8ZLaZgU9Cg1Yyl+RDTb6DhFaiw=="}} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:48:52.531389 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.quota [None req-389be3c3-5ba8-45cd-bbe0-c6c9082eab40 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Getting quotas for project b981336000334d7d8451feaacc75da99. Resources: {'key_pairs'} {{(pid=127141) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 04:48:52.535972 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.quota [None req-389be3c3-5ba8-45cd-bbe0-c6c9082eab40 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Getting quotas for user 673b4f55a335484d927d7966d72690ad and project b981336000334d7d8451feaacc75da99. Resources: {'key_pairs'} {{(pid=127141) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 04:48:52.563239 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-389be3c3-5ba8-45cd-bbe0-c6c9082eab40 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.258408 Sep 25 04:48:52.563929 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 548/1166] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Sep 25 04:48:52 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 04:49:18.401468 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-e52d5e8d-5b21-4cf9-9f0b-d184d596e6ed tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-346159470", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1260319028", "security_groups": [{"name": "tempest-secgroup-smoke-820761321"}], "networks": [{"uuid": "d9e4d8b5-d949-40c2-a892-90d10583d469"}], "block_device_mapping_v2": [{"uuid": "b1eecf32-362c-48a4-a20c-18e9dc8051d4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:49:18.412147 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:49:18.412817 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=44 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:49:18.521376 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.network.neutron [None req-e52d5e8d-5b21-4cf9-9f0b-d184d596e6ed tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] validate_networks() for [('d9e4d8b5-d949-40c2-a892-90d10583d469', None, None, None, None, None)] {{(pid=127142) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 04:49:18.988738 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-e52d5e8d-5b21-4cf9-9f0b-d184d596e6ed tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Flavor limits 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 04:49:18.989164 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-e52d5e8d-5b21-4cf9-9f0b-d184d596e6ed tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Image limits 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 04:49:18.989672 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-e52d5e8d-5b21-4cf9-9f0b-d184d596e6ed tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Flavor pref 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 04:49:18.990082 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-e52d5e8d-5b21-4cf9-9f0b-d184d596e6ed tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Image pref 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 04:49:18.990498 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-e52d5e8d-5b21-4cf9-9f0b-d184d596e6ed tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 04:49:18.999141 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e52d5e8d-5b21-4cf9-9f0b-d184d596e6ed tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:18.999619 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e52d5e8d-5b21-4cf9-9f0b-d184d596e6ed tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:19.000051 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e52d5e8d-5b21-4cf9-9f0b-d184d596e6ed tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:19.000816 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e52d5e8d-5b21-4cf9-9f0b-d184d596e6ed tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:19.001272 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e52d5e8d-5b21-4cf9-9f0b-d184d596e6ed tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:19.001696 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e52d5e8d-5b21-4cf9-9f0b-d184d596e6ed tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:19.019119 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.quota [None req-e52d5e8d-5b21-4cf9-9f0b-d184d596e6ed tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Getting quotas for project b981336000334d7d8451feaacc75da99. Resources: {'instances', 'ram', 'cores'} {{(pid=127142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 04:49:19.023166 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.quota [None req-e52d5e8d-5b21-4cf9-9f0b-d184d596e6ed tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Getting quotas for user 673b4f55a335484d927d7966d72690ad and project b981336000334d7d8451feaacc75da99. Resources: {'instances', 'ram', 'cores'} {{(pid=127142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 04:49:19.079310 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-e52d5e8d-5b21-4cf9-9f0b-d184d596e6ed tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Going to run 1 instances... {{(pid=127142) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 04:49:19.081450 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-e52d5e8d-5b21-4cf9-9f0b-d184d596e6ed tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b1eecf32-362c-48a4-a20c-18e9dc8051d4',volume_size=None,volume_type=None)] {{(pid=127142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 04:49:19.216520 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e52d5e8d-5b21-4cf9-9f0b-d184d596e6ed tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [589d5110-ccd5-4de5-a896-97426be9bf63] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 25 04:49:20.224611 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO oslo.messaging._drivers.impl_rabbit [None req-e52d5e8d-5b21-4cf9-9f0b-d184d596e6ed tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [589d5110-ccd5-4de5-a896-97426be9bf63] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 45578. Sep 25 04:49:20.228356 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-e52d5e8d-5b21-4cf9-9f0b-d184d596e6ed tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.830763 Sep 25 04:49:20.229032 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 619/1167] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 25 04:49:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 1832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 04:49:20.238968 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell0:SELECT=4 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:49:20.239711 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:49:20.246220 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-67214aa5-2096-4095-a815-93297f056d13 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:49:20.247623 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-67214aa5-2096-4095-a815-93297f056d13 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:49:20.306915 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-67214aa5-2096-4095-a815-93297f056d13 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:49:20.315090 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-67214aa5-2096-4095-a815-93297f056d13 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1088 microversion: 2.1 time: 0.078629 Sep 25 04:49:20.315858 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 549/1168] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:49:20 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1088 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:49:21.339750 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-a14cd5c6-6e84-4542-94a8-43279fa5bfa8 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:49:21.340306 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-a14cd5c6-6e84-4542-94a8-43279fa5bfa8 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:49:21.346372 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a14cd5c6-6e84-4542-94a8-43279fa5bfa8 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:21.346896 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a14cd5c6-6e84-4542-94a8-43279fa5bfa8 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:21.347346 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a14cd5c6-6e84-4542-94a8-43279fa5bfa8 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:21.348027 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a14cd5c6-6e84-4542-94a8-43279fa5bfa8 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:21.348476 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a14cd5c6-6e84-4542-94a8-43279fa5bfa8 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:21.348951 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a14cd5c6-6e84-4542-94a8-43279fa5bfa8 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:21.415496 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-a14cd5c6-6e84-4542-94a8-43279fa5bfa8 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:49:21.423857 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-a14cd5c6-6e84-4542-94a8-43279fa5bfa8 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1186 microversion: 2.1 time: 0.089078 Sep 25 04:49:21.424426 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 620/1169] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:49:21 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1186 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:49:22.447502 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-2750ff35-cda6-4c8c-b6bd-1f26f4fa1d24 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:49:22.448235 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-2750ff35-cda6-4c8c-b6bd-1f26f4fa1d24 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:49:22.454714 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2750ff35-cda6-4c8c-b6bd-1f26f4fa1d24 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:22.455286 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2750ff35-cda6-4c8c-b6bd-1f26f4fa1d24 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:22.456505 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2750ff35-cda6-4c8c-b6bd-1f26f4fa1d24 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:22.457369 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2750ff35-cda6-4c8c-b6bd-1f26f4fa1d24 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:22.457860 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2750ff35-cda6-4c8c-b6bd-1f26f4fa1d24 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:22.458288 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2750ff35-cda6-4c8c-b6bd-1f26f4fa1d24 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:22.705389 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-2750ff35-cda6-4c8c-b6bd-1f26f4fa1d24 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:49:22.719293 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-2750ff35-cda6-4c8c-b6bd-1f26f4fa1d24 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1259 microversion: 2.1 time: 0.275654 Sep 25 04:49:22.724358 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 550/1170] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:49:22 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1259 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:49:22.920595 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-882b3db3-6800-46f2-92f7-99ba2a534f39 req-e5a77281-84f8-4065-9b09-4b121cd58bfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe8e79dd-3c8b-432d-aee1-0ca947d8affe", "tag": "2eced77b-cebd-4659-801e-16aa388746bd"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:49:22.932197 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-882b3db3-6800-46f2-92f7-99ba2a534f39 req-e5a77281-84f8-4065-9b09-4b121cd58bfe service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:22.932798 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-882b3db3-6800-46f2-92f7-99ba2a534f39 req-e5a77281-84f8-4065-9b09-4b121cd58bfe service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:22.933238 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-882b3db3-6800-46f2-92f7-99ba2a534f39 req-e5a77281-84f8-4065-9b09-4b121cd58bfe service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:22.944805 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-882b3db3-6800-46f2-92f7-99ba2a534f39 req-e5a77281-84f8-4065-9b09-4b121cd58bfe service nova] Creating event network-changed:2eced77b-cebd-4659-801e-16aa388746bd for instance fe8e79dd-3c8b-432d-aee1-0ca947d8affe on hv-cinder-85535 Sep 25 04:49:22.949689 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-882b3db3-6800-46f2-92f7-99ba2a534f39 req-e5a77281-84f8-4065-9b09-4b121cd58bfe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032893 Sep 25 04:49:22.950272 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 621/1171] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:49:23.743640 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-99d8d398-ad95-4e57-989d-ab5e46bb504f tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:49:23.744258 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-99d8d398-ad95-4e57-989d-ab5e46bb504f tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:49:23.750757 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-99d8d398-ad95-4e57-989d-ab5e46bb504f tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:23.751281 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-99d8d398-ad95-4e57-989d-ab5e46bb504f tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:23.751722 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-99d8d398-ad95-4e57-989d-ab5e46bb504f tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:23.752417 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-99d8d398-ad95-4e57-989d-ab5e46bb504f tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:23.752924 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-99d8d398-ad95-4e57-989d-ab5e46bb504f tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:23.753345 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-99d8d398-ad95-4e57-989d-ab5e46bb504f tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:23.888990 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-99d8d398-ad95-4e57-989d-ab5e46bb504f tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:49:23.896574 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-99d8d398-ad95-4e57-989d-ab5e46bb504f tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1259 microversion: 2.1 time: 0.156872 Sep 25 04:49:23.897161 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 551/1172] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:49:23 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:49:24.919700 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-91c9eb27-f4d3-48f6-99c3-fed4fd98bfbc tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:49:24.920472 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-91c9eb27-f4d3-48f6-99c3-fed4fd98bfbc tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:49:24.928591 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-91c9eb27-f4d3-48f6-99c3-fed4fd98bfbc tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:24.929313 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-91c9eb27-f4d3-48f6-99c3-fed4fd98bfbc tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:24.929688 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-91c9eb27-f4d3-48f6-99c3-fed4fd98bfbc tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:24.930605 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-91c9eb27-f4d3-48f6-99c3-fed4fd98bfbc tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:24.931157 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-91c9eb27-f4d3-48f6-99c3-fed4fd98bfbc tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:24.931779 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-91c9eb27-f4d3-48f6-99c3-fed4fd98bfbc tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:25.399191 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-91c9eb27-f4d3-48f6-99c3-fed4fd98bfbc tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:49:25.406949 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-91c9eb27-f4d3-48f6-99c3-fed4fd98bfbc tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1259 microversion: 2.1 time: 0.491297 Sep 25 04:49:25.407514 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 622/1173] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:49:24 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1259 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:49:26.430372 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-1baaaae6-ad5e-4dd5-a72e-6d761aebac15 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:49:26.430994 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-1baaaae6-ad5e-4dd5-a72e-6d761aebac15 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:49:26.437769 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1baaaae6-ad5e-4dd5-a72e-6d761aebac15 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:26.438258 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1baaaae6-ad5e-4dd5-a72e-6d761aebac15 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:26.438696 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1baaaae6-ad5e-4dd5-a72e-6d761aebac15 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:26.439387 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1baaaae6-ad5e-4dd5-a72e-6d761aebac15 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:26.439843 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1baaaae6-ad5e-4dd5-a72e-6d761aebac15 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:26.440273 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1baaaae6-ad5e-4dd5-a72e-6d761aebac15 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:26.572574 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-1baaaae6-ad5e-4dd5-a72e-6d761aebac15 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:49:26.580141 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-1baaaae6-ad5e-4dd5-a72e-6d761aebac15 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1259 microversion: 2.1 time: 0.153660 Sep 25 04:49:26.581333 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 552/1174] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:49:26 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:49:27.603423 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-df1ad3a4-b771-4906-8a58-061cd94561f7 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:49:27.603970 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-df1ad3a4-b771-4906-8a58-061cd94561f7 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:49:27.610227 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-df1ad3a4-b771-4906-8a58-061cd94561f7 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:27.610706 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-df1ad3a4-b771-4906-8a58-061cd94561f7 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:27.611142 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-df1ad3a4-b771-4906-8a58-061cd94561f7 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:27.611879 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-df1ad3a4-b771-4906-8a58-061cd94561f7 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:27.612554 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-df1ad3a4-b771-4906-8a58-061cd94561f7 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:27.613003 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-df1ad3a4-b771-4906-8a58-061cd94561f7 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:27.743747 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-df1ad3a4-b771-4906-8a58-061cd94561f7 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:49:27.751507 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-df1ad3a4-b771-4906-8a58-061cd94561f7 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1259 microversion: 2.1 time: 0.152025 Sep 25 04:49:27.752069 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 623/1175] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:49:27 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:49:28.774295 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-610c1485-6cc8-4bc1-bd78-c624bd1ab254 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:49:28.774958 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-610c1485-6cc8-4bc1-bd78-c624bd1ab254 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:49:28.781364 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-610c1485-6cc8-4bc1-bd78-c624bd1ab254 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:28.781851 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-610c1485-6cc8-4bc1-bd78-c624bd1ab254 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:28.782290 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-610c1485-6cc8-4bc1-bd78-c624bd1ab254 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:28.782978 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-610c1485-6cc8-4bc1-bd78-c624bd1ab254 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:28.783433 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-610c1485-6cc8-4bc1-bd78-c624bd1ab254 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:28.784092 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-610c1485-6cc8-4bc1-bd78-c624bd1ab254 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:28.916148 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-610c1485-6cc8-4bc1-bd78-c624bd1ab254 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:49:28.923791 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-610c1485-6cc8-4bc1-bd78-c624bd1ab254 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1259 microversion: 2.1 time: 0.153405 Sep 25 04:49:28.924929 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 553/1176] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:49:28 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:49:29.947368 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-6e1666a9-d4c5-4f5f-92cd-8a4463bfe3d9 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:49:29.947980 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-6e1666a9-d4c5-4f5f-92cd-8a4463bfe3d9 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:49:29.950426 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell0:SELECT=2 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:49:29.951110 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell0:SELECT=6 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:49:29.957647 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6e1666a9-d4c5-4f5f-92cd-8a4463bfe3d9 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:29.958134 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6e1666a9-d4c5-4f5f-92cd-8a4463bfe3d9 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:29.958569 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6e1666a9-d4c5-4f5f-92cd-8a4463bfe3d9 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:29.959253 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6e1666a9-d4c5-4f5f-92cd-8a4463bfe3d9 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:29.959706 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6e1666a9-d4c5-4f5f-92cd-8a4463bfe3d9 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:29.960127 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6e1666a9-d4c5-4f5f-92cd-8a4463bfe3d9 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:30.091674 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-6e1666a9-d4c5-4f5f-92cd-8a4463bfe3d9 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:49:30.099619 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-6e1666a9-d4c5-4f5f-92cd-8a4463bfe3d9 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1259 microversion: 2.1 time: 0.156094 Sep 25 04:49:30.100181 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 624/1177] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:49:29 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:49:31.122819 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-506eca44-c3a9-4950-9d4a-ccbf8cd52849 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:49:31.123466 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-506eca44-c3a9-4950-9d4a-ccbf8cd52849 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:49:31.125858 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell0:SELECT=2 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:49:31.131727 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-506eca44-c3a9-4950-9d4a-ccbf8cd52849 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:31.132222 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-506eca44-c3a9-4950-9d4a-ccbf8cd52849 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:31.132686 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-506eca44-c3a9-4950-9d4a-ccbf8cd52849 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:31.133385 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-506eca44-c3a9-4950-9d4a-ccbf8cd52849 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:31.133845 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-506eca44-c3a9-4950-9d4a-ccbf8cd52849 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:31.134274 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-506eca44-c3a9-4950-9d4a-ccbf8cd52849 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:31.262801 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-506eca44-c3a9-4950-9d4a-ccbf8cd52849 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:49:31.271127 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-506eca44-c3a9-4950-9d4a-ccbf8cd52849 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1259 microversion: 2.1 time: 0.152163 Sep 25 04:49:31.271635 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 554/1178] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:49:31 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:49:32.294884 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-26001a3a-d4c8-426a-92e1-8792c78bead5 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:49:32.295507 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-26001a3a-d4c8-426a-92e1-8792c78bead5 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:49:32.302694 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-26001a3a-d4c8-426a-92e1-8792c78bead5 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:32.303174 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-26001a3a-d4c8-426a-92e1-8792c78bead5 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:32.303611 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-26001a3a-d4c8-426a-92e1-8792c78bead5 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:32.304329 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-26001a3a-d4c8-426a-92e1-8792c78bead5 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:32.304825 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-26001a3a-d4c8-426a-92e1-8792c78bead5 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:32.305256 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-26001a3a-d4c8-426a-92e1-8792c78bead5 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:32.437510 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-26001a3a-d4c8-426a-92e1-8792c78bead5 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:49:32.445283 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-26001a3a-d4c8-426a-92e1-8792c78bead5 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1259 microversion: 2.1 time: 0.154260 Sep 25 04:49:32.445847 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 625/1179] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:49:32 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:49:33.468802 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-07fcae48-c2e5-4200-b7bc-2c5721cfdd2a tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:49:33.469420 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-07fcae48-c2e5-4200-b7bc-2c5721cfdd2a tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:49:33.476685 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-07fcae48-c2e5-4200-b7bc-2c5721cfdd2a tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:33.477181 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-07fcae48-c2e5-4200-b7bc-2c5721cfdd2a tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:33.477616 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-07fcae48-c2e5-4200-b7bc-2c5721cfdd2a tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:33.478314 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-07fcae48-c2e5-4200-b7bc-2c5721cfdd2a tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:33.478770 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-07fcae48-c2e5-4200-b7bc-2c5721cfdd2a tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:33.479188 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-07fcae48-c2e5-4200-b7bc-2c5721cfdd2a tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:33.618782 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-07fcae48-c2e5-4200-b7bc-2c5721cfdd2a tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:49:33.626972 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-07fcae48-c2e5-4200-b7bc-2c5721cfdd2a tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1259 microversion: 2.1 time: 0.162151 Sep 25 04:49:33.627606 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 555/1180] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:49:33 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:49:34.650215 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-cf000501-7ca7-428b-a4c7-725344783432 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:49:34.650819 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-cf000501-7ca7-428b-a4c7-725344783432 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:49:34.657649 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cf000501-7ca7-428b-a4c7-725344783432 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:34.658218 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cf000501-7ca7-428b-a4c7-725344783432 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:34.659282 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cf000501-7ca7-428b-a4c7-725344783432 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:34.659990 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cf000501-7ca7-428b-a4c7-725344783432 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:34.660450 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cf000501-7ca7-428b-a4c7-725344783432 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:34.661041 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cf000501-7ca7-428b-a4c7-725344783432 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:34.798814 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-cf000501-7ca7-428b-a4c7-725344783432 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:49:34.807222 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-cf000501-7ca7-428b-a4c7-725344783432 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1259 microversion: 2.1 time: 0.160827 Sep 25 04:49:34.807736 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 626/1181] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:49:34 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:49:35.801747 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [req-03d1b943-98d4-4663-b40f-362fc9e73624 req-e815befc-977e-4ec0-8b41-708e22808c4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe8e79dd-3c8b-432d-aee1-0ca947d8affe", "name": "network-vif-plugged", "status": "completed", "tag": "2eced77b-cebd-4659-801e-16aa388746bd"}]} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:49:35.811323 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-03d1b943-98d4-4663-b40f-362fc9e73624 req-e815befc-977e-4ec0-8b41-708e22808c4f service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:35.811797 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-03d1b943-98d4-4663-b40f-362fc9e73624 req-e815befc-977e-4ec0-8b41-708e22808c4f service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:35.812227 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-03d1b943-98d4-4663-b40f-362fc9e73624 req-e815befc-977e-4ec0-8b41-708e22808c4f service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:35.823023 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.compute.server_external_events [req-03d1b943-98d4-4663-b40f-362fc9e73624 req-e815befc-977e-4ec0-8b41-708e22808c4f service nova] Creating event network-vif-plugged:2eced77b-cebd-4659-801e-16aa388746bd for instance fe8e79dd-3c8b-432d-aee1-0ca947d8affe on hv-cinder-85535 Sep 25 04:49:35.828523 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [req-03d1b943-98d4-4663-b40f-362fc9e73624 req-e815befc-977e-4ec0-8b41-708e22808c4f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157352 Sep 25 04:49:35.829126 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 556/1182] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:49:35.829964 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-db33400d-305d-49ee-959a-2d9643e976ba tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:49:35.831419 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-db33400d-305d-49ee-959a-2d9643e976ba tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:49:35.837955 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-db33400d-305d-49ee-959a-2d9643e976ba tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:35.838444 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-db33400d-305d-49ee-959a-2d9643e976ba tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:35.839167 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-db33400d-305d-49ee-959a-2d9643e976ba tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:35.839863 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-db33400d-305d-49ee-959a-2d9643e976ba tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:35.840322 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-db33400d-305d-49ee-959a-2d9643e976ba tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:35.840778 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-db33400d-305d-49ee-959a-2d9643e976ba tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:35.976834 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-db33400d-305d-49ee-959a-2d9643e976ba tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:49:35.985080 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-db33400d-305d-49ee-959a-2d9643e976ba tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1259 microversion: 2.1 time: 0.159057 Sep 25 04:49:35.985647 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 627/1183] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:49:35 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:49:37.009792 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-db3c2a12-9551-406d-95cc-a2b6bca48186 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:49:37.010482 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-db3c2a12-9551-406d-95cc-a2b6bca48186 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:49:37.016662 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-db3c2a12-9551-406d-95cc-a2b6bca48186 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:37.017157 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-db3c2a12-9551-406d-95cc-a2b6bca48186 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:37.017589 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-db3c2a12-9551-406d-95cc-a2b6bca48186 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:37.018788 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-db3c2a12-9551-406d-95cc-a2b6bca48186 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:37.019457 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-db3c2a12-9551-406d-95cc-a2b6bca48186 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:37.019645 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-db3c2a12-9551-406d-95cc-a2b6bca48186 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:37.151433 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-db3c2a12-9551-406d-95cc-a2b6bca48186 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:49:37.159169 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-db3c2a12-9551-406d-95cc-a2b6bca48186 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1259 microversion: 2.1 time: 0.154120 Sep 25 04:49:37.159722 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 557/1184] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:49:37 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:49:38.182635 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-6a353b62-e7f8-4bad-9d45-169cd913ef07 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:49:38.183290 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-6a353b62-e7f8-4bad-9d45-169cd913ef07 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:49:38.189897 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6a353b62-e7f8-4bad-9d45-169cd913ef07 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:38.190470 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6a353b62-e7f8-4bad-9d45-169cd913ef07 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:38.190913 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6a353b62-e7f8-4bad-9d45-169cd913ef07 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:38.191606 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6a353b62-e7f8-4bad-9d45-169cd913ef07 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:38.192095 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6a353b62-e7f8-4bad-9d45-169cd913ef07 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:38.192526 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-6a353b62-e7f8-4bad-9d45-169cd913ef07 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:38.321073 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-6a353b62-e7f8-4bad-9d45-169cd913ef07 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:49:38.328717 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-6a353b62-e7f8-4bad-9d45-169cd913ef07 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1259 microversion: 2.1 time: 0.149952 Sep 25 04:49:38.329289 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 628/1185] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:49:38 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:49:39.351617 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-937c6ca8-ca3b-4bd4-8b7d-1f376989e200 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:49:39.352232 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-937c6ca8-ca3b-4bd4-8b7d-1f376989e200 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:49:39.358820 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-937c6ca8-ca3b-4bd4-8b7d-1f376989e200 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:39.359304 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-937c6ca8-ca3b-4bd4-8b7d-1f376989e200 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:39.359745 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-937c6ca8-ca3b-4bd4-8b7d-1f376989e200 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:39.360433 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-937c6ca8-ca3b-4bd4-8b7d-1f376989e200 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:39.360955 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-937c6ca8-ca3b-4bd4-8b7d-1f376989e200 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:39.362161 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-937c6ca8-ca3b-4bd4-8b7d-1f376989e200 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:39.494369 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-937c6ca8-ca3b-4bd4-8b7d-1f376989e200 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:49:39.502768 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-937c6ca8-ca3b-4bd4-8b7d-1f376989e200 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1259 microversion: 2.1 time: 0.154393 Sep 25 04:49:39.503338 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 558/1186] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:49:39 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:49:40.526218 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-0e312a97-6e19-4588-b2b9-2976494eca28 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:49:40.526832 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-0e312a97-6e19-4588-b2b9-2976494eca28 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:49:40.533895 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0e312a97-6e19-4588-b2b9-2976494eca28 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:40.534396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0e312a97-6e19-4588-b2b9-2976494eca28 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:40.534825 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0e312a97-6e19-4588-b2b9-2976494eca28 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:40.535501 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0e312a97-6e19-4588-b2b9-2976494eca28 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:40.535951 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0e312a97-6e19-4588-b2b9-2976494eca28 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:40.536371 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0e312a97-6e19-4588-b2b9-2976494eca28 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:40.667127 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-0e312a97-6e19-4588-b2b9-2976494eca28 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:49:40.675448 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-0e312a97-6e19-4588-b2b9-2976494eca28 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1259 microversion: 2.1 time: 0.153131 Sep 25 04:49:40.676016 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 629/1187] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:49:40 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:49:41.697676 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-382c9995-2079-49b6-9bdb-1c9c00c48107 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:49:41.698303 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-382c9995-2079-49b6-9bdb-1c9c00c48107 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:49:41.705025 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-382c9995-2079-49b6-9bdb-1c9c00c48107 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:41.705502 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-382c9995-2079-49b6-9bdb-1c9c00c48107 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:41.705937 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-382c9995-2079-49b6-9bdb-1c9c00c48107 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:41.706617 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-382c9995-2079-49b6-9bdb-1c9c00c48107 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:41.707073 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-382c9995-2079-49b6-9bdb-1c9c00c48107 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:41.707494 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-382c9995-2079-49b6-9bdb-1c9c00c48107 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:41.855351 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-382c9995-2079-49b6-9bdb-1c9c00c48107 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:49:41.863677 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-382c9995-2079-49b6-9bdb-1c9c00c48107 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1444 microversion: 2.1 time: 0.169887 Sep 25 04:49:41.864246 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 559/1188] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:49:41 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1444 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:49:41.887108 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-7492fc5f-b83a-4616-b724-7b288ec2b893 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:49:41.887714 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-7492fc5f-b83a-4616-b724-7b288ec2b893 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:49:41.894583 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7492fc5f-b83a-4616-b724-7b288ec2b893 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:41.895063 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7492fc5f-b83a-4616-b724-7b288ec2b893 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:41.895496 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7492fc5f-b83a-4616-b724-7b288ec2b893 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:41.896176 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7492fc5f-b83a-4616-b724-7b288ec2b893 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:41.896623 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7492fc5f-b83a-4616-b724-7b288ec2b893 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:41.897070 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-7492fc5f-b83a-4616-b724-7b288ec2b893 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:42.036989 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-7492fc5f-b83a-4616-b724-7b288ec2b893 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:49:42.046392 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-7492fc5f-b83a-4616-b724-7b288ec2b893 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1444 microversion: 2.1 time: 0.163329 Sep 25 04:49:42.047149 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 630/1189] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:49:41 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1444 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:49:44.025267 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [req-2a24b855-c71d-442e-90e3-d509e0d9a243 req-9bf2367d-0582-4eda-8e79-f36a7112f00d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe8e79dd-3c8b-432d-aee1-0ca947d8affe", "tag": "2eced77b-cebd-4659-801e-16aa388746bd"}]} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:49:44.037127 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-2a24b855-c71d-442e-90e3-d509e0d9a243 req-9bf2367d-0582-4eda-8e79-f36a7112f00d service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:44.038044 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-2a24b855-c71d-442e-90e3-d509e0d9a243 req-9bf2367d-0582-4eda-8e79-f36a7112f00d service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:44.038483 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-2a24b855-c71d-442e-90e3-d509e0d9a243 req-9bf2367d-0582-4eda-8e79-f36a7112f00d service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:44.053443 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.compute.server_external_events [req-2a24b855-c71d-442e-90e3-d509e0d9a243 req-9bf2367d-0582-4eda-8e79-f36a7112f00d service nova] Creating event network-changed:2eced77b-cebd-4659-801e-16aa388746bd for instance fe8e79dd-3c8b-432d-aee1-0ca947d8affe on hv-cinder-85535 Sep 25 04:49:44.059370 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [req-2a24b855-c71d-442e-90e3-d509e0d9a243 req-9bf2367d-0582-4eda-8e79-f36a7112f00d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094220 Sep 25 04:49:44.060042 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 560/1190] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:49:55.273409 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-a8951db4-4669-4a2e-b484-e3a55048c63a tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-956653351", "imageRef": "e5cfdbb2-d0ce-4736-b311-1a3c155844e9", "flavorRef": "452", "networks": [{"uuid": "3f74a169-556f-472f-ab01-95a16d2b72de"}]}} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:49:55.282457 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:49:55.283187 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=64 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:49:55.328408 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.network.neutron [None req-a8951db4-4669-4a2e-b484-e3a55048c63a tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] validate_networks() for [('3f74a169-556f-472f-ab01-95a16d2b72de', None, None, None, None, None)] {{(pid=127142) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 04:49:55.666585 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-a8951db4-4669-4a2e-b484-e3a55048c63a tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Flavor limits 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 04:49:55.667009 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-a8951db4-4669-4a2e-b484-e3a55048c63a tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Image limits 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 04:49:55.667479 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-a8951db4-4669-4a2e-b484-e3a55048c63a tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Flavor pref 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 04:49:55.667884 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-a8951db4-4669-4a2e-b484-e3a55048c63a tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Image pref 0:0:0 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 04:49:55.668316 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.virt.hardware [None req-a8951db4-4669-4a2e-b484-e3a55048c63a tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 04:49:55.677920 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a8951db4-4669-4a2e-b484-e3a55048c63a tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:55.678398 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a8951db4-4669-4a2e-b484-e3a55048c63a tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:55.678827 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a8951db4-4669-4a2e-b484-e3a55048c63a tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:55.679545 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a8951db4-4669-4a2e-b484-e3a55048c63a tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:55.679991 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a8951db4-4669-4a2e-b484-e3a55048c63a tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:55.680414 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a8951db4-4669-4a2e-b484-e3a55048c63a tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:55.697130 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.quota [None req-a8951db4-4669-4a2e-b484-e3a55048c63a tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Getting quotas for project 38de016089e0474d9a2b16cfecaf0a60. Resources: {'instances', 'ram', 'cores'} {{(pid=127142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 04:49:55.701085 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.quota [None req-a8951db4-4669-4a2e-b484-e3a55048c63a tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Getting quotas for user 0c481f7a811a438e809b3bb8a8e4c127 and project 38de016089e0474d9a2b16cfecaf0a60. Resources: {'instances', 'ram', 'cores'} {{(pid=127142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 04:49:55.712734 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-a8951db4-4669-4a2e-b484-e3a55048c63a tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Going to run 1 instances... {{(pid=127142) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 04:49:55.715242 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-a8951db4-4669-4a2e-b484-e3a55048c63a tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] [instance: 2f9ca2d6-56bf-41da-b53f-d201e5bfde7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5cfdbb2-d0ce-4736-b311-1a3c155844e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 04:49:55.761358 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-a8951db4-4669-4a2e-b484-e3a55048c63a tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.491743 Sep 25 04:49:55.762024 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 631/1191] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 25 04:49:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 04:49:55.774425 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-4541b403-ed5e-4883-91a2-9472dd386cec tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:49:55.775112 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-4541b403-ed5e-4883-91a2-9472dd386cec tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] [instance: 2f9ca2d6-56bf-41da-b53f-d201e5bfde7c] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:49:55.777482 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_api:SELECT=26 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:49:55.778390 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=58 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:49:55.837333 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-4541b403-ed5e-4883-91a2-9472dd386cec tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c481f7a811a438e809b3bb8a8e4c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38de016089e0474d9a2b16cfecaf0a60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:49:55.844517 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-4541b403-ed5e-4883-91a2-9472dd386cec tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] 10.222.0.25 "GET /compute/v2.1/servers/2f9ca2d6-56bf-41da-b53f-d201e5bfde7c" status: 200 len: 1218 microversion: 2.1 time: 0.074380 Sep 25 04:49:55.845462 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 561/1192] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:49:55 2022] GET /compute/v2.1/servers/2f9ca2d6-56bf-41da-b53f-d201e5bfde7c => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:49:56.868132 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-841a4360-a612-4a31-8602-eb5e314e253f tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:49:56.868797 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-841a4360-a612-4a31-8602-eb5e314e253f tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] [instance: 2f9ca2d6-56bf-41da-b53f-d201e5bfde7c] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:49:56.874784 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-841a4360-a612-4a31-8602-eb5e314e253f tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:56.875270 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-841a4360-a612-4a31-8602-eb5e314e253f tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:56.875710 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-841a4360-a612-4a31-8602-eb5e314e253f tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:56.876933 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-841a4360-a612-4a31-8602-eb5e314e253f tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:56.877635 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-841a4360-a612-4a31-8602-eb5e314e253f tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:56.877974 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-841a4360-a612-4a31-8602-eb5e314e253f tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:56.970931 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-841a4360-a612-4a31-8602-eb5e314e253f tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c481f7a811a438e809b3bb8a8e4c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38de016089e0474d9a2b16cfecaf0a60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:49:56.978978 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-841a4360-a612-4a31-8602-eb5e314e253f tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] 10.222.0.25 "GET /compute/v2.1/servers/2f9ca2d6-56bf-41da-b53f-d201e5bfde7c" status: 200 len: 1278 microversion: 2.1 time: 0.115442 Sep 25 04:49:56.982119 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 632/1193] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:49:56 2022] GET /compute/v2.1/servers/2f9ca2d6-56bf-41da-b53f-d201e5bfde7c => generated 1278 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:49:58.003660 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-b9ce5490-2b9d-4fae-8928-43ddd3903217 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:49:58.004288 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-b9ce5490-2b9d-4fae-8928-43ddd3903217 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] [instance: 2f9ca2d6-56bf-41da-b53f-d201e5bfde7c] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:49:58.011034 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b9ce5490-2b9d-4fae-8928-43ddd3903217 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:58.011526 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b9ce5490-2b9d-4fae-8928-43ddd3903217 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:58.011969 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b9ce5490-2b9d-4fae-8928-43ddd3903217 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:58.012739 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b9ce5490-2b9d-4fae-8928-43ddd3903217 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:58.013205 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b9ce5490-2b9d-4fae-8928-43ddd3903217 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:58.013635 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-b9ce5490-2b9d-4fae-8928-43ddd3903217 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:58.222400 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-b9ce5490-2b9d-4fae-8928-43ddd3903217 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c481f7a811a438e809b3bb8a8e4c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38de016089e0474d9a2b16cfecaf0a60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:49:58.230031 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-b9ce5490-2b9d-4fae-8928-43ddd3903217 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] 10.222.0.25 "GET /compute/v2.1/servers/2f9ca2d6-56bf-41da-b53f-d201e5bfde7c" status: 200 len: 1318 microversion: 2.1 time: 0.231217 Sep 25 04:49:58.230604 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 562/1194] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:49:57 2022] GET /compute/v2.1/servers/2f9ca2d6-56bf-41da-b53f-d201e5bfde7c => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:49:58.343588 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-2435fdc1-c7fc-4250-bfd6-2a51d3e16b53 req-ee2b85fa-c7e5-45de-9bf0-c0336d68e987 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f9ca2d6-56bf-41da-b53f-d201e5bfde7c", "tag": "244cf4dc-4f97-4cce-a3d6-b8d8b7cd0274"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:49:58.354068 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-2435fdc1-c7fc-4250-bfd6-2a51d3e16b53 req-ee2b85fa-c7e5-45de-9bf0-c0336d68e987 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:58.354545 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-2435fdc1-c7fc-4250-bfd6-2a51d3e16b53 req-ee2b85fa-c7e5-45de-9bf0-c0336d68e987 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:58.355088 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-2435fdc1-c7fc-4250-bfd6-2a51d3e16b53 req-ee2b85fa-c7e5-45de-9bf0-c0336d68e987 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:58.366814 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-2435fdc1-c7fc-4250-bfd6-2a51d3e16b53 req-ee2b85fa-c7e5-45de-9bf0-c0336d68e987 service nova] Creating event network-changed:244cf4dc-4f97-4cce-a3d6-b8d8b7cd0274 for instance 2f9ca2d6-56bf-41da-b53f-d201e5bfde7c on hv-cinder-85535 Sep 25 04:49:58.371758 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-2435fdc1-c7fc-4250-bfd6-2a51d3e16b53 req-ee2b85fa-c7e5-45de-9bf0-c0336d68e987 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031839 Sep 25 04:49:58.372350 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 633/1195] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:49:59.254621 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-8126eb1e-d75c-4c59-a776-128e3df7086f tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:49:59.255207 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-8126eb1e-d75c-4c59-a776-128e3df7086f tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] [instance: 2f9ca2d6-56bf-41da-b53f-d201e5bfde7c] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:49:59.261924 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8126eb1e-d75c-4c59-a776-128e3df7086f tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:59.262404 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8126eb1e-d75c-4c59-a776-128e3df7086f tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:59.262837 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8126eb1e-d75c-4c59-a776-128e3df7086f tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:59.263521 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8126eb1e-d75c-4c59-a776-128e3df7086f tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:49:59.263972 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8126eb1e-d75c-4c59-a776-128e3df7086f tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:49:59.264394 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-8126eb1e-d75c-4c59-a776-128e3df7086f tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:49:59.393855 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-8126eb1e-d75c-4c59-a776-128e3df7086f tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c481f7a811a438e809b3bb8a8e4c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38de016089e0474d9a2b16cfecaf0a60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:49:59.401498 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-8126eb1e-d75c-4c59-a776-128e3df7086f tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] 10.222.0.25 "GET /compute/v2.1/servers/2f9ca2d6-56bf-41da-b53f-d201e5bfde7c" status: 200 len: 1318 microversion: 2.1 time: 0.151389 Sep 25 04:49:59.402069 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 563/1196] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:49:59 2022] GET /compute/v2.1/servers/2f9ca2d6-56bf-41da-b53f-d201e5bfde7c => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:50:00.426940 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-fa101bc7-7b55-42cb-af29-d66d12e2d118 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:50:00.427661 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-fa101bc7-7b55-42cb-af29-d66d12e2d118 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] [instance: 2f9ca2d6-56bf-41da-b53f-d201e5bfde7c] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:50:00.434336 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fa101bc7-7b55-42cb-af29-d66d12e2d118 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:50:00.434814 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fa101bc7-7b55-42cb-af29-d66d12e2d118 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:50:00.435300 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fa101bc7-7b55-42cb-af29-d66d12e2d118 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:50:00.435988 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fa101bc7-7b55-42cb-af29-d66d12e2d118 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:50:00.436437 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fa101bc7-7b55-42cb-af29-d66d12e2d118 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:50:00.436889 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-fa101bc7-7b55-42cb-af29-d66d12e2d118 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:50:00.565387 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-fa101bc7-7b55-42cb-af29-d66d12e2d118 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c481f7a811a438e809b3bb8a8e4c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38de016089e0474d9a2b16cfecaf0a60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:50:00.573009 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-fa101bc7-7b55-42cb-af29-d66d12e2d118 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] 10.222.0.25 "GET /compute/v2.1/servers/2f9ca2d6-56bf-41da-b53f-d201e5bfde7c" status: 200 len: 1318 microversion: 2.1 time: 0.152139 Sep 25 04:50:00.573568 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 634/1197] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:50:00 2022] GET /compute/v2.1/servers/2f9ca2d6-56bf-41da-b53f-d201e5bfde7c => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:50:01.596118 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-80ac765c-d259-40e2-8215-77deb5b0ae0f tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:50:01.596712 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-80ac765c-d259-40e2-8215-77deb5b0ae0f tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] [instance: 2f9ca2d6-56bf-41da-b53f-d201e5bfde7c] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:50:01.603096 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-80ac765c-d259-40e2-8215-77deb5b0ae0f tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:50:01.603583 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-80ac765c-d259-40e2-8215-77deb5b0ae0f tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:50:01.604014 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-80ac765c-d259-40e2-8215-77deb5b0ae0f tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:50:01.604730 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-80ac765c-d259-40e2-8215-77deb5b0ae0f tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:50:01.605183 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-80ac765c-d259-40e2-8215-77deb5b0ae0f tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:50:01.605646 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-80ac765c-d259-40e2-8215-77deb5b0ae0f tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:50:01.812308 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-80ac765c-d259-40e2-8215-77deb5b0ae0f tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c481f7a811a438e809b3bb8a8e4c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38de016089e0474d9a2b16cfecaf0a60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:50:01.828078 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-80ac765c-d259-40e2-8215-77deb5b0ae0f tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] 10.222.0.25 "GET /compute/v2.1/servers/2f9ca2d6-56bf-41da-b53f-d201e5bfde7c" status: 200 len: 1318 microversion: 2.1 time: 0.235695 Sep 25 04:50:01.828909 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 564/1198] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:50:01 2022] GET /compute/v2.1/servers/2f9ca2d6-56bf-41da-b53f-d201e5bfde7c => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:50:02.852010 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-ee1377af-9804-4113-93d8-b6c8e15298d7 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:50:02.852654 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-ee1377af-9804-4113-93d8-b6c8e15298d7 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] [instance: 2f9ca2d6-56bf-41da-b53f-d201e5bfde7c] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:50:02.859307 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ee1377af-9804-4113-93d8-b6c8e15298d7 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:50:02.859800 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ee1377af-9804-4113-93d8-b6c8e15298d7 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:50:02.860247 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ee1377af-9804-4113-93d8-b6c8e15298d7 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:50:02.861012 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ee1377af-9804-4113-93d8-b6c8e15298d7 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:50:02.861498 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ee1377af-9804-4113-93d8-b6c8e15298d7 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:50:02.861900 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ee1377af-9804-4113-93d8-b6c8e15298d7 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:50:03.076076 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-ee1377af-9804-4113-93d8-b6c8e15298d7 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c481f7a811a438e809b3bb8a8e4c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38de016089e0474d9a2b16cfecaf0a60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:50:03.084438 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-ee1377af-9804-4113-93d8-b6c8e15298d7 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] 10.222.0.25 "GET /compute/v2.1/servers/2f9ca2d6-56bf-41da-b53f-d201e5bfde7c" status: 200 len: 1318 microversion: 2.1 time: 0.236344 Sep 25 04:50:03.085196 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 635/1199] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:50:02 2022] GET /compute/v2.1/servers/2f9ca2d6-56bf-41da-b53f-d201e5bfde7c => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:50:03.685602 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [req-f3cc304e-e3f4-4f8b-950b-4969963dfe26 req-1c806395-82aa-40fb-8eef-aec368362979 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f9ca2d6-56bf-41da-b53f-d201e5bfde7c", "name": "network-vif-plugged", "status": "completed", "tag": "244cf4dc-4f97-4cce-a3d6-b8d8b7cd0274"}]} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:50:03.695636 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-f3cc304e-e3f4-4f8b-950b-4969963dfe26 req-1c806395-82aa-40fb-8eef-aec368362979 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:50:03.696366 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-f3cc304e-e3f4-4f8b-950b-4969963dfe26 req-1c806395-82aa-40fb-8eef-aec368362979 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:50:03.697020 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-f3cc304e-e3f4-4f8b-950b-4969963dfe26 req-1c806395-82aa-40fb-8eef-aec368362979 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:50:03.708860 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.compute.server_external_events [req-f3cc304e-e3f4-4f8b-950b-4969963dfe26 req-1c806395-82aa-40fb-8eef-aec368362979 service nova] Creating event network-vif-plugged:244cf4dc-4f97-4cce-a3d6-b8d8b7cd0274 for instance 2f9ca2d6-56bf-41da-b53f-d201e5bfde7c on hv-cinder-85535 Sep 25 04:50:03.713712 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [req-f3cc304e-e3f4-4f8b-950b-4969963dfe26 req-1c806395-82aa-40fb-8eef-aec368362979 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031721 Sep 25 04:50:03.714777 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 565/1200] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 04:50:04.107374 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-01080beb-b320-488c-827b-396fbad1e4f6 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:50:04.107992 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-01080beb-b320-488c-827b-396fbad1e4f6 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] [instance: 2f9ca2d6-56bf-41da-b53f-d201e5bfde7c] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:50:04.114711 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-01080beb-b320-488c-827b-396fbad1e4f6 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:50:04.115201 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-01080beb-b320-488c-827b-396fbad1e4f6 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:50:04.115643 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-01080beb-b320-488c-827b-396fbad1e4f6 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:50:04.116338 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-01080beb-b320-488c-827b-396fbad1e4f6 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:50:04.116832 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-01080beb-b320-488c-827b-396fbad1e4f6 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:50:04.117263 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-01080beb-b320-488c-827b-396fbad1e4f6 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:50:04.244935 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-01080beb-b320-488c-827b-396fbad1e4f6 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c481f7a811a438e809b3bb8a8e4c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38de016089e0474d9a2b16cfecaf0a60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:50:04.253477 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-01080beb-b320-488c-827b-396fbad1e4f6 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] 10.222.0.25 "GET /compute/v2.1/servers/2f9ca2d6-56bf-41da-b53f-d201e5bfde7c" status: 200 len: 1318 microversion: 2.1 time: 0.149986 Sep 25 04:50:04.254059 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 636/1201] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:50:04 2022] GET /compute/v2.1/servers/2f9ca2d6-56bf-41da-b53f-d201e5bfde7c => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:50:05.277798 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-d0e34e6c-1477-40ed-9a22-471bb85854bc tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:50:05.278483 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-d0e34e6c-1477-40ed-9a22-471bb85854bc tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] [instance: 2f9ca2d6-56bf-41da-b53f-d201e5bfde7c] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:50:05.285502 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d0e34e6c-1477-40ed-9a22-471bb85854bc tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:50:05.285922 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d0e34e6c-1477-40ed-9a22-471bb85854bc tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:50:05.286356 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d0e34e6c-1477-40ed-9a22-471bb85854bc tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:50:05.287040 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d0e34e6c-1477-40ed-9a22-471bb85854bc tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:50:05.287494 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d0e34e6c-1477-40ed-9a22-471bb85854bc tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:50:05.287916 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-d0e34e6c-1477-40ed-9a22-471bb85854bc tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:50:05.418549 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-d0e34e6c-1477-40ed-9a22-471bb85854bc tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c481f7a811a438e809b3bb8a8e4c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38de016089e0474d9a2b16cfecaf0a60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:50:05.427215 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-d0e34e6c-1477-40ed-9a22-471bb85854bc tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] 10.222.0.25 "GET /compute/v2.1/servers/2f9ca2d6-56bf-41da-b53f-d201e5bfde7c" status: 200 len: 1318 microversion: 2.1 time: 0.154040 Sep 25 04:50:05.427770 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 566/1202] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:50:05 2022] GET /compute/v2.1/servers/2f9ca2d6-56bf-41da-b53f-d201e5bfde7c => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:50:06.450025 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-0b18a513-49c4-49c3-b7d8-4df18160c9b4 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:50:06.450642 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-0b18a513-49c4-49c3-b7d8-4df18160c9b4 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] [instance: 2f9ca2d6-56bf-41da-b53f-d201e5bfde7c] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:50:06.453107 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell0:SELECT=2 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:50:06.453799 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell0:SELECT=6 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:50:06.459915 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0b18a513-49c4-49c3-b7d8-4df18160c9b4 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:50:06.460397 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0b18a513-49c4-49c3-b7d8-4df18160c9b4 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:50:06.460879 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0b18a513-49c4-49c3-b7d8-4df18160c9b4 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:50:06.461584 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0b18a513-49c4-49c3-b7d8-4df18160c9b4 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:50:06.462031 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0b18a513-49c4-49c3-b7d8-4df18160c9b4 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:50:06.462454 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-0b18a513-49c4-49c3-b7d8-4df18160c9b4 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:50:06.594622 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-0b18a513-49c4-49c3-b7d8-4df18160c9b4 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c481f7a811a438e809b3bb8a8e4c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38de016089e0474d9a2b16cfecaf0a60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:50:06.602868 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-0b18a513-49c4-49c3-b7d8-4df18160c9b4 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] 10.222.0.25 "GET /compute/v2.1/servers/2f9ca2d6-56bf-41da-b53f-d201e5bfde7c" status: 200 len: 1507 microversion: 2.1 time: 0.156737 Sep 25 04:50:06.603437 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 637/1203] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:50:06 2022] GET /compute/v2.1/servers/2f9ca2d6-56bf-41da-b53f-d201e5bfde7c => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:50:30.224678 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-31cb8a2d-d5ff-4e0e-9aec-a93d274eaee6 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "107b3a90-dc42-422c-a76f-cf098df9b34b", "device": "/dev/sdb"}} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:50:30.227487 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-31cb8a2d-d5ff-4e0e-9aec-a93d274eaee6 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] [instance: 2f9ca2d6-56bf-41da-b53f-d201e5bfde7c] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:50:30.229509 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell0:SELECT=2 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:50:30.230291 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_api:SELECT=14 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:50:30.230968 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=26 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:50:30.237908 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-31cb8a2d-d5ff-4e0e-9aec-a93d274eaee6 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:50:30.238394 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-31cb8a2d-d5ff-4e0e-9aec-a93d274eaee6 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:50:30.238822 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-31cb8a2d-d5ff-4e0e-9aec-a93d274eaee6 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:50:30.239507 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-31cb8a2d-d5ff-4e0e-9aec-a93d274eaee6 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:50:30.239958 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-31cb8a2d-d5ff-4e0e-9aec-a93d274eaee6 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:50:30.240380 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-31cb8a2d-d5ff-4e0e-9aec-a93d274eaee6 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:50:30.502740 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-31cb8a2d-d5ff-4e0e-9aec-a93d274eaee6 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] 10.222.0.25 "POST /compute/v2.1/servers/2f9ca2d6-56bf-41da-b53f-d201e5bfde7c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282023 Sep 25 04:50:30.503351 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 567/1204] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Sep 25 04:50:30 2022] POST /compute/v2.1/servers/2f9ca2d6-56bf-41da-b53f-d201e5bfde7c/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:50:57.299979 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-cd3c025e-2585-4fe2-b056-32e42355156c tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:50:57.300478 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-cd3c025e-2585-4fe2-b056-32e42355156c tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] [instance: 2f9ca2d6-56bf-41da-b53f-d201e5bfde7c] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:50:57.302638 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:50:57.303399 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=34 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:50:57.309721 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cd3c025e-2585-4fe2-b056-32e42355156c tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:50:57.310208 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cd3c025e-2585-4fe2-b056-32e42355156c tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:50:57.310696 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cd3c025e-2585-4fe2-b056-32e42355156c tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:50:57.311342 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cd3c025e-2585-4fe2-b056-32e42355156c tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:50:57.311799 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cd3c025e-2585-4fe2-b056-32e42355156c tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:50:57.312229 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-cd3c025e-2585-4fe2-b056-32e42355156c tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:50:57.393400 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.objects.instance [None req-cd3c025e-2585-4fe2-b056-32e42355156c tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lazy-loading 'services' on Instance uuid 2f9ca2d6-56bf-41da-b53f-d201e5bfde7c {{(pid=127142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 04:50:57.464290 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-cd3c025e-2585-4fe2-b056-32e42355156c tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2f9ca2d6-56bf-41da-b53f-d201e5bfde7c/os-volume_attachments/107b3a90-dc42-422c-a76f-cf098df9b34b" status: 202 len: 0 microversion: 2.1 time: 0.168495 Sep 25 04:50:57.464913 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 638/1205] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Sep 25 04:50:57 2022] DELETE /compute/v2.1/servers/2f9ca2d6-56bf-41da-b53f-d201e5bfde7c/os-volume_attachments/107b3a90-dc42-422c-a76f-cf098df9b34b => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 04:50:58.590357 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_api:SELECT=2 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:50:58.591262 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:50:58.596456 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-096e64e9-3bcc-49b1-a9d6-b45222723c50 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:50:58.597074 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-096e64e9-3bcc-49b1-a9d6-b45222723c50 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] [instance: 2f9ca2d6-56bf-41da-b53f-d201e5bfde7c] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:50:58.604444 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-096e64e9-3bcc-49b1-a9d6-b45222723c50 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:50:58.604951 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-096e64e9-3bcc-49b1-a9d6-b45222723c50 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:50:58.605388 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-096e64e9-3bcc-49b1-a9d6-b45222723c50 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:50:58.606070 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-096e64e9-3bcc-49b1-a9d6-b45222723c50 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:50:58.606525 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-096e64e9-3bcc-49b1-a9d6-b45222723c50 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:50:58.606948 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-096e64e9-3bcc-49b1-a9d6-b45222723c50 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:50:58.635899 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-096e64e9-3bcc-49b1-a9d6-b45222723c50 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] [instance: 2f9ca2d6-56bf-41da-b53f-d201e5bfde7c] Going to try to terminate instance {{(pid=127141) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 04:50:58.718693 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-096e64e9-3bcc-49b1-a9d6-b45222723c50 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2f9ca2d6-56bf-41da-b53f-d201e5bfde7c" status: 204 len: 0 microversion: 2.1 time: 0.129883 Sep 25 04:50:58.720168 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 568/1206] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 25 04:50:58 2022] DELETE /compute/v2.1/servers/2f9ca2d6-56bf-41da-b53f-d201e5bfde7c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 04:50:58.729608 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-ae1e8a38-2644-4c90-be52-bab1f9087ff7 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:50:58.730344 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-ae1e8a38-2644-4c90-be52-bab1f9087ff7 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] [instance: 2f9ca2d6-56bf-41da-b53f-d201e5bfde7c] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:50:58.737011 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ae1e8a38-2644-4c90-be52-bab1f9087ff7 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:50:58.737745 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ae1e8a38-2644-4c90-be52-bab1f9087ff7 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:50:58.738188 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ae1e8a38-2644-4c90-be52-bab1f9087ff7 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:50:58.738886 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ae1e8a38-2644-4c90-be52-bab1f9087ff7 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:50:58.739340 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ae1e8a38-2644-4c90-be52-bab1f9087ff7 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:50:58.739932 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-ae1e8a38-2644-4c90-be52-bab1f9087ff7 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:50:58.877559 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-ae1e8a38-2644-4c90-be52-bab1f9087ff7 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c481f7a811a438e809b3bb8a8e4c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38de016089e0474d9a2b16cfecaf0a60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:50:58.887007 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-ae1e8a38-2644-4c90-be52-bab1f9087ff7 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] 10.222.0.25 "GET /compute/v2.1/servers/2f9ca2d6-56bf-41da-b53f-d201e5bfde7c" status: 200 len: 1513 microversion: 2.1 time: 0.162290 Sep 25 04:50:58.887597 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 639/1207] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:50:58 2022] GET /compute/v2.1/servers/2f9ca2d6-56bf-41da-b53f-d201e5bfde7c => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:50:59.910727 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-321f21c0-6d76-47eb-99c7-28e202f0eee1 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:50:59.911414 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-321f21c0-6d76-47eb-99c7-28e202f0eee1 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] [instance: 2f9ca2d6-56bf-41da-b53f-d201e5bfde7c] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:50:59.918670 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-321f21c0-6d76-47eb-99c7-28e202f0eee1 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:50:59.919145 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-321f21c0-6d76-47eb-99c7-28e202f0eee1 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:50:59.919576 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-321f21c0-6d76-47eb-99c7-28e202f0eee1 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:50:59.920259 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-321f21c0-6d76-47eb-99c7-28e202f0eee1 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:50:59.920743 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-321f21c0-6d76-47eb-99c7-28e202f0eee1 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:50:59.921164 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-321f21c0-6d76-47eb-99c7-28e202f0eee1 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:51:00.169120 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-321f21c0-6d76-47eb-99c7-28e202f0eee1 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c481f7a811a438e809b3bb8a8e4c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38de016089e0474d9a2b16cfecaf0a60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:51:00.178456 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-321f21c0-6d76-47eb-99c7-28e202f0eee1 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] 10.222.0.25 "GET /compute/v2.1/servers/2f9ca2d6-56bf-41da-b53f-d201e5bfde7c" status: 200 len: 1513 microversion: 2.1 time: 0.272113 Sep 25 04:51:00.179340 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 569/1208] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:50:59 2022] GET /compute/v2.1/servers/2f9ca2d6-56bf-41da-b53f-d201e5bfde7c => generated 1513 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:51:01.201987 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-12ada014-af0d-4f71-bc62-51ab6e69a646 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:51:01.202706 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-12ada014-af0d-4f71-bc62-51ab6e69a646 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] [instance: 2f9ca2d6-56bf-41da-b53f-d201e5bfde7c] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:51:01.209898 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-12ada014-af0d-4f71-bc62-51ab6e69a646 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:51:01.210423 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-12ada014-af0d-4f71-bc62-51ab6e69a646 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:51:01.211221 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-12ada014-af0d-4f71-bc62-51ab6e69a646 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:51:01.211942 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-12ada014-af0d-4f71-bc62-51ab6e69a646 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:51:01.212434 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-12ada014-af0d-4f71-bc62-51ab6e69a646 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:51:01.212939 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-12ada014-af0d-4f71-bc62-51ab6e69a646 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:51:01.483438 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-12ada014-af0d-4f71-bc62-51ab6e69a646 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c481f7a811a438e809b3bb8a8e4c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38de016089e0474d9a2b16cfecaf0a60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:51:01.491940 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-12ada014-af0d-4f71-bc62-51ab6e69a646 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] 10.222.0.25 "GET /compute/v2.1/servers/2f9ca2d6-56bf-41da-b53f-d201e5bfde7c" status: 200 len: 1513 microversion: 2.1 time: 0.293818 Sep 25 04:51:01.492599 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 640/1209] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:51:01 2022] GET /compute/v2.1/servers/2f9ca2d6-56bf-41da-b53f-d201e5bfde7c => generated 1513 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:51:01.608360 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [req-08d1bbeb-1a0e-42f1-ab5c-ccaa7b111e3e req-d991b1f5-a905-4e47-b9da-8515d66bd62f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f9ca2d6-56bf-41da-b53f-d201e5bfde7c", "name": "network-vif-deleted", "tag": "244cf4dc-4f97-4cce-a3d6-b8d8b7cd0274"}]} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:51:01.620544 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-08d1bbeb-1a0e-42f1-ab5c-ccaa7b111e3e req-d991b1f5-a905-4e47-b9da-8515d66bd62f service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:51:01.621056 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-08d1bbeb-1a0e-42f1-ab5c-ccaa7b111e3e req-d991b1f5-a905-4e47-b9da-8515d66bd62f service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:51:01.621488 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-08d1bbeb-1a0e-42f1-ab5c-ccaa7b111e3e req-d991b1f5-a905-4e47-b9da-8515d66bd62f service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:51:01.634246 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.compute.server_external_events [req-08d1bbeb-1a0e-42f1-ab5c-ccaa7b111e3e req-d991b1f5-a905-4e47-b9da-8515d66bd62f service nova] Creating event network-vif-deleted:244cf4dc-4f97-4cce-a3d6-b8d8b7cd0274 for instance 2f9ca2d6-56bf-41da-b53f-d201e5bfde7c on hv-cinder-85535 Sep 25 04:51:01.639945 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [req-08d1bbeb-1a0e-42f1-ab5c-ccaa7b111e3e req-d991b1f5-a905-4e47-b9da-8515d66bd62f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035449 Sep 25 04:51:01.641444 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 570/1210] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:51:02.516551 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-051ee70d-4b01-4e08-8319-9c78ca47d7db tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:51:02.517278 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-051ee70d-4b01-4e08-8319-9c78ca47d7db tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] [instance: 2f9ca2d6-56bf-41da-b53f-d201e5bfde7c] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:51:02.523660 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-051ee70d-4b01-4e08-8319-9c78ca47d7db tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:51:02.524138 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-051ee70d-4b01-4e08-8319-9c78ca47d7db tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:51:02.524573 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-051ee70d-4b01-4e08-8319-9c78ca47d7db tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:51:02.525281 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-051ee70d-4b01-4e08-8319-9c78ca47d7db tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:51:02.525756 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-051ee70d-4b01-4e08-8319-9c78ca47d7db tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:51:02.526181 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-051ee70d-4b01-4e08-8319-9c78ca47d7db tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:51:02.539328 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.wsgi [None req-051ee70d-4b01-4e08-8319-9c78ca47d7db tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] HTTP exception thrown: Instance 2f9ca2d6-56bf-41da-b53f-d201e5bfde7c could not be found. Sep 25 04:51:02.541017 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-051ee70d-4b01-4e08-8319-9c78ca47d7db tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Request method failure captured: Sep 25 04:51:02.541017 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: request: GET /compute/v2.1/servers/2f9ca2d6-56bf-41da-b53f-d201e5bfde7c HTTP/1.1 Sep 25 04:51:02.541017 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept: application/json Sep 25 04:51:02.541017 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept-Encoding: identity Sep 25 04:51:02.541017 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Connection: close Sep 25 04:51:02.541017 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Length: 0 Sep 25 04:51:02.541017 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Type: application/json Sep 25 04:51:02.541017 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Host: 10.222.0.25 Sep 25 04:51:02.541017 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Openstack-System-Scope: None Sep 25 04:51:02.541017 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: User-Agent: python-urllib3/1.26.12 Sep 25 04:51:02.541017 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Auth-Token: gAAAAABjL93xtd50VlhJXADAdRQlk2dag9GRbPbFL7pDHrU19D1a3HZ0pgFZ-EYwuL7MYvT6mgwxoB421aDRLYlTeeT-7TX4tEI0-lmKI5deRVv-WEZQNDKqjeLKBFGrU_wHh8ZDIQpYHlZgq21wKm9mMaoz50bYtKFENe7qu-BO3wax1Dko4Zs Sep 25 04:51:02.541017 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Id: None Sep 25 04:51:02.541017 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Name: None Sep 25 04:51:02.541017 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Identity-Status: Confirmed Sep 25 04:51:02.541017 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Is-Admin-Project: True Sep 25 04:51:02.541017 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Id: default Sep 25 04:51:02.541017 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Name: Default Sep 25 04:51:02.541017 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Id: 38de016089e0474d9a2b16cfecaf0a60 Sep 25 04:51:02.541017 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1053816945 Sep 25 04:51:02.541017 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Role: reader,member Sep 25 04:51:02.541017 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Roles: reader,member Sep 25 04:51:02.542889 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/38de016089e0474d9a2b16cfecaf0a60"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38de016089e0474d9a2b16cfecaf0a60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38de016089e0474d9a2b16cfecaf0a60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_38de016089e0474d9a2b16cfecaf0a60"}]}] Sep 25 04:51:02.542889 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant: tempest-VolumesSnapshotTestJSON-1053816945 Sep 25 04:51:02.542889 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Id: 38de016089e0474d9a2b16cfecaf0a60 Sep 25 04:51:02.542889 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1053816945 Sep 25 04:51:02.542889 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User: tempest-VolumesSnapshotTestJSON-1053816945-project Sep 25 04:51:02.542889 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Id: default Sep 25 04:51:02.542889 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Name: Default Sep 25 04:51:02.542889 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Id: 0c481f7a811a438e809b3bb8a8e4c127 Sep 25 04:51:02.542889 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Name: tempest-VolumesSnapshotTestJSON-1053816945-project Sep 25 04:51:02.542889 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: method: > Sep 25 04:51:02.542889 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: exception: Instance 2f9ca2d6-56bf-41da-b53f-d201e5bfde7c could not be found. Sep 25 04:51:02.542889 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: action_args: {'id': '2f9ca2d6-56bf-41da-b53f-d201e5bfde7c'} Sep 25 04:51:02.543965 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:51:02.543965 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:51:02.543965 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:51:02.543965 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:51:02.543965 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:51:02.543965 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:51:02.543965 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:51:02.543965 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:51:02.543965 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:51:02.543965 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:51:02.543965 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f9ca2d6-56bf-41da-b53f-d201e5bfde7c could not be found. Sep 25 04:51:02.543965 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:51:02.543965 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:51:02.543965 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:51:02.543965 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:51:02.543965 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:51:02.543965 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:51:02.543965 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:51:02.543965 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:51:02.543965 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:51:02.545725 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:51:02.545725 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 04:51:02.545725 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 04:51:02.545725 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:51:02.545725 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:51:02.545725 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:51:02.545725 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:51:02.545725 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f9ca2d6-56bf-41da-b53f-d201e5bfde7c could not be found. Sep 25 04:51:02.545725 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:51:02.545725 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:51:02.545725 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:51:02.545725 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:51:02.545725 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:51:02.545725 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:51:02.545725 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:51:02.545725 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:51:02.545725 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f9ca2d6-56bf-41da-b53f-d201e5bfde7c could not be found. Sep 25 04:51:02.545725 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:51:02.547559 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-051ee70d-4b01-4e08-8319-9c78ca47d7db tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Returning 404 to user: Instance 2f9ca2d6-56bf-41da-b53f-d201e5bfde7c could not be found. {{(pid=127142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:51:02.547559 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-051ee70d-4b01-4e08-8319-9c78ca47d7db tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] 10.222.0.25 "GET /compute/v2.1/servers/2f9ca2d6-56bf-41da-b53f-d201e5bfde7c" status: 404 len: 111 microversion: 2.1 time: 0.030348 Sep 25 04:51:02.547559 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 641/1211] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:51:02 2022] GET /compute/v2.1/servers/2f9ca2d6-56bf-41da-b53f-d201e5bfde7c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 04:51:12.401550 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-41734f98-5796-417b-95f2-a909b9fd6c9e tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-413465213", "imageRef": "e5cfdbb2-d0ce-4736-b311-1a3c155844e9", "flavorRef": "452", "networks": [{"uuid": "3f74a169-556f-472f-ab01-95a16d2b72de"}]}} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:51:12.410566 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 25 04:51:12.410719 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Sun Sep 25 04:51:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Sep 25 04:51:12.411763 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:51:12.412418 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:51:12.458617 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.network.neutron [None req-41734f98-5796-417b-95f2-a909b9fd6c9e tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] validate_networks() for [('3f74a169-556f-472f-ab01-95a16d2b72de', None, None, None, None, None)] {{(pid=127141) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 04:51:12.863146 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-41734f98-5796-417b-95f2-a909b9fd6c9e tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Flavor limits 0:0:0 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 04:51:12.863568 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-41734f98-5796-417b-95f2-a909b9fd6c9e tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Image limits 0:0:0 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 04:51:12.864065 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-41734f98-5796-417b-95f2-a909b9fd6c9e tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Flavor pref 0:0:0 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 04:51:12.864505 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-41734f98-5796-417b-95f2-a909b9fd6c9e tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Image pref 0:0:0 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 04:51:12.864952 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.virt.hardware [None req-41734f98-5796-417b-95f2-a909b9fd6c9e tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 04:51:12.874311 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-41734f98-5796-417b-95f2-a909b9fd6c9e tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:51:12.875499 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-41734f98-5796-417b-95f2-a909b9fd6c9e tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:51:12.875943 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-41734f98-5796-417b-95f2-a909b9fd6c9e tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:51:12.876896 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-41734f98-5796-417b-95f2-a909b9fd6c9e tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:51:12.877364 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-41734f98-5796-417b-95f2-a909b9fd6c9e tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:51:12.877795 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-41734f98-5796-417b-95f2-a909b9fd6c9e tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:51:12.894411 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.quota [None req-41734f98-5796-417b-95f2-a909b9fd6c9e tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Getting quotas for project 38de016089e0474d9a2b16cfecaf0a60. Resources: {'instances', 'ram', 'cores'} {{(pid=127141) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 04:51:12.898368 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.quota [None req-41734f98-5796-417b-95f2-a909b9fd6c9e tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Getting quotas for user 0c481f7a811a438e809b3bb8a8e4c127 and project 38de016089e0474d9a2b16cfecaf0a60. Resources: {'instances', 'ram', 'cores'} {{(pid=127141) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 04:51:12.909272 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-41734f98-5796-417b-95f2-a909b9fd6c9e tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Going to run 1 instances... {{(pid=127141) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 04:51:12.911629 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-41734f98-5796-417b-95f2-a909b9fd6c9e tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] [instance: 7949b4da-6f1f-407b-ae66-6469b930574f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5cfdbb2-d0ce-4736-b311-1a3c155844e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127141) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 04:51:12.958236 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-41734f98-5796-417b-95f2-a909b9fd6c9e tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.560893 Sep 25 04:51:12.962811 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 571/1212] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Sep 25 04:51:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 04:51:12.971080 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-5e0daf59-7d71-4f06-8496-99c7ea2bfd20 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:51:12.971830 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-5e0daf59-7d71-4f06-8496-99c7ea2bfd20 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] [instance: 7949b4da-6f1f-407b-ae66-6469b930574f] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:51:12.975313 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_api:SELECT=8 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:51:12.976221 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:51:13.033400 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-5e0daf59-7d71-4f06-8496-99c7ea2bfd20 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c481f7a811a438e809b3bb8a8e4c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38de016089e0474d9a2b16cfecaf0a60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:51:13.041163 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-5e0daf59-7d71-4f06-8496-99c7ea2bfd20 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] 10.222.0.25 "GET /compute/v2.1/servers/7949b4da-6f1f-407b-ae66-6469b930574f" status: 200 len: 1218 microversion: 2.1 time: 0.074780 Sep 25 04:51:13.042439 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 642/1213] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:51:12 2022] GET /compute/v2.1/servers/7949b4da-6f1f-407b-ae66-6469b930574f => generated 1218 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:51:14.066410 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-801ac112-c133-4dbb-8a79-a69e17f58939 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:51:14.067149 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-801ac112-c133-4dbb-8a79-a69e17f58939 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] [instance: 7949b4da-6f1f-407b-ae66-6469b930574f] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:51:14.074297 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-801ac112-c133-4dbb-8a79-a69e17f58939 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:51:14.075045 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-801ac112-c133-4dbb-8a79-a69e17f58939 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:51:14.075480 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-801ac112-c133-4dbb-8a79-a69e17f58939 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:51:14.076255 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-801ac112-c133-4dbb-8a79-a69e17f58939 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:51:14.076731 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-801ac112-c133-4dbb-8a79-a69e17f58939 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:51:14.077348 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-801ac112-c133-4dbb-8a79-a69e17f58939 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:51:14.158382 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-801ac112-c133-4dbb-8a79-a69e17f58939 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c481f7a811a438e809b3bb8a8e4c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38de016089e0474d9a2b16cfecaf0a60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:51:14.166779 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-801ac112-c133-4dbb-8a79-a69e17f58939 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] 10.222.0.25 "GET /compute/v2.1/servers/7949b4da-6f1f-407b-ae66-6469b930574f" status: 200 len: 1288 microversion: 2.1 time: 0.105702 Sep 25 04:51:14.167510 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 572/1214] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:51:14 2022] GET /compute/v2.1/servers/7949b4da-6f1f-407b-ae66-6469b930574f => generated 1288 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:51:15.190746 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-c4856725-ae2f-49af-aac7-6790f02e30af tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:51:15.191370 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-c4856725-ae2f-49af-aac7-6790f02e30af tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] [instance: 7949b4da-6f1f-407b-ae66-6469b930574f] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:51:15.198682 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c4856725-ae2f-49af-aac7-6790f02e30af tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:51:15.199177 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c4856725-ae2f-49af-aac7-6790f02e30af tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:51:15.199650 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c4856725-ae2f-49af-aac7-6790f02e30af tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:51:15.200350 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c4856725-ae2f-49af-aac7-6790f02e30af tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:51:15.200848 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c4856725-ae2f-49af-aac7-6790f02e30af tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:51:15.201283 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c4856725-ae2f-49af-aac7-6790f02e30af tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:51:15.385215 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-c4856725-ae2f-49af-aac7-6790f02e30af tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c481f7a811a438e809b3bb8a8e4c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38de016089e0474d9a2b16cfecaf0a60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:51:15.393867 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-c4856725-ae2f-49af-aac7-6790f02e30af tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] 10.222.0.25 "GET /compute/v2.1/servers/7949b4da-6f1f-407b-ae66-6469b930574f" status: 200 len: 1318 microversion: 2.1 time: 0.207006 Sep 25 04:51:15.394449 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 643/1215] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:51:15 2022] GET /compute/v2.1/servers/7949b4da-6f1f-407b-ae66-6469b930574f => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:51:15.430842 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [req-9bffc2b0-e5bd-48e5-8b05-2dc7271b3db1 req-402d5dc7-fc6c-494c-92c3-bec9d6d1cb25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7949b4da-6f1f-407b-ae66-6469b930574f", "tag": "82c314f0-90e1-4a31-9545-0725576fe7dd"}]} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:51:15.443060 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-9bffc2b0-e5bd-48e5-8b05-2dc7271b3db1 req-402d5dc7-fc6c-494c-92c3-bec9d6d1cb25 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:51:15.443552 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-9bffc2b0-e5bd-48e5-8b05-2dc7271b3db1 req-402d5dc7-fc6c-494c-92c3-bec9d6d1cb25 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:51:15.444265 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-9bffc2b0-e5bd-48e5-8b05-2dc7271b3db1 req-402d5dc7-fc6c-494c-92c3-bec9d6d1cb25 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:51:15.456129 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.compute.server_external_events [req-9bffc2b0-e5bd-48e5-8b05-2dc7271b3db1 req-402d5dc7-fc6c-494c-92c3-bec9d6d1cb25 service nova] Creating event network-changed:82c314f0-90e1-4a31-9545-0725576fe7dd for instance 7949b4da-6f1f-407b-ae66-6469b930574f on hv-cinder-85535 Sep 25 04:51:15.461271 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [req-9bffc2b0-e5bd-48e5-8b05-2dc7271b3db1 req-402d5dc7-fc6c-494c-92c3-bec9d6d1cb25 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035157 Sep 25 04:51:15.461873 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 573/1216] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:51:16.417987 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-545ec1f7-f155-4f3b-8019-03c40e9ede0f tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:51:16.418609 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-545ec1f7-f155-4f3b-8019-03c40e9ede0f tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] [instance: 7949b4da-6f1f-407b-ae66-6469b930574f] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:51:16.425612 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-545ec1f7-f155-4f3b-8019-03c40e9ede0f tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:51:16.426130 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-545ec1f7-f155-4f3b-8019-03c40e9ede0f tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:51:16.426563 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-545ec1f7-f155-4f3b-8019-03c40e9ede0f tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:51:16.427278 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-545ec1f7-f155-4f3b-8019-03c40e9ede0f tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:51:16.427768 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-545ec1f7-f155-4f3b-8019-03c40e9ede0f tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:51:16.428189 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-545ec1f7-f155-4f3b-8019-03c40e9ede0f tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:51:16.557931 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-545ec1f7-f155-4f3b-8019-03c40e9ede0f tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c481f7a811a438e809b3bb8a8e4c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38de016089e0474d9a2b16cfecaf0a60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:51:16.565519 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-545ec1f7-f155-4f3b-8019-03c40e9ede0f tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] 10.222.0.25 "GET /compute/v2.1/servers/7949b4da-6f1f-407b-ae66-6469b930574f" status: 200 len: 1318 microversion: 2.1 time: 0.151702 Sep 25 04:51:16.566085 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 644/1217] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:51:16 2022] GET /compute/v2.1/servers/7949b4da-6f1f-407b-ae66-6469b930574f => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:51:17.589431 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-a4f98387-e6ff-4b25-ad34-d4f3cdecee1b tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:51:17.590158 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-a4f98387-e6ff-4b25-ad34-d4f3cdecee1b tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] [instance: 7949b4da-6f1f-407b-ae66-6469b930574f] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:51:17.597432 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a4f98387-e6ff-4b25-ad34-d4f3cdecee1b tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:51:17.597915 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a4f98387-e6ff-4b25-ad34-d4f3cdecee1b tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:51:17.598353 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a4f98387-e6ff-4b25-ad34-d4f3cdecee1b tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:51:17.599040 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a4f98387-e6ff-4b25-ad34-d4f3cdecee1b tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:51:17.599496 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a4f98387-e6ff-4b25-ad34-d4f3cdecee1b tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:51:17.599922 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a4f98387-e6ff-4b25-ad34-d4f3cdecee1b tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:51:17.726202 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-a4f98387-e6ff-4b25-ad34-d4f3cdecee1b tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c481f7a811a438e809b3bb8a8e4c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38de016089e0474d9a2b16cfecaf0a60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:51:17.733899 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-a4f98387-e6ff-4b25-ad34-d4f3cdecee1b tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] 10.222.0.25 "GET /compute/v2.1/servers/7949b4da-6f1f-407b-ae66-6469b930574f" status: 200 len: 1318 microversion: 2.1 time: 0.148947 Sep 25 04:51:17.734934 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 574/1218] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:51:17 2022] GET /compute/v2.1/servers/7949b4da-6f1f-407b-ae66-6469b930574f => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:51:18.757082 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-d4a1a786-5063-490f-8528-a7c9c19ae462 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:51:18.757698 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-d4a1a786-5063-490f-8528-a7c9c19ae462 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] [instance: 7949b4da-6f1f-407b-ae66-6469b930574f] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:51:18.764075 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d4a1a786-5063-490f-8528-a7c9c19ae462 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:51:18.764557 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d4a1a786-5063-490f-8528-a7c9c19ae462 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:51:18.765038 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d4a1a786-5063-490f-8528-a7c9c19ae462 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:51:18.765761 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d4a1a786-5063-490f-8528-a7c9c19ae462 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:51:18.766214 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d4a1a786-5063-490f-8528-a7c9c19ae462 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:51:18.766639 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d4a1a786-5063-490f-8528-a7c9c19ae462 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:51:18.899839 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-d4a1a786-5063-490f-8528-a7c9c19ae462 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c481f7a811a438e809b3bb8a8e4c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38de016089e0474d9a2b16cfecaf0a60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:51:18.908034 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-d4a1a786-5063-490f-8528-a7c9c19ae462 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] 10.222.0.25 "GET /compute/v2.1/servers/7949b4da-6f1f-407b-ae66-6469b930574f" status: 200 len: 1318 microversion: 2.1 time: 0.154974 Sep 25 04:51:18.908592 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 645/1219] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:51:18 2022] GET /compute/v2.1/servers/7949b4da-6f1f-407b-ae66-6469b930574f => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:51:19.931202 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-e943ad90-2e6f-46a2-8e43-ccca9deba73e tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:51:19.931821 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-e943ad90-2e6f-46a2-8e43-ccca9deba73e tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] [instance: 7949b4da-6f1f-407b-ae66-6469b930574f] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:51:19.938759 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e943ad90-2e6f-46a2-8e43-ccca9deba73e tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:51:19.939252 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e943ad90-2e6f-46a2-8e43-ccca9deba73e tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:51:19.939696 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e943ad90-2e6f-46a2-8e43-ccca9deba73e tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:51:19.940394 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e943ad90-2e6f-46a2-8e43-ccca9deba73e tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:51:19.940887 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e943ad90-2e6f-46a2-8e43-ccca9deba73e tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:51:19.941324 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-e943ad90-2e6f-46a2-8e43-ccca9deba73e tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:51:20.066435 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-e943ad90-2e6f-46a2-8e43-ccca9deba73e tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c481f7a811a438e809b3bb8a8e4c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38de016089e0474d9a2b16cfecaf0a60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:51:20.074153 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-e943ad90-2e6f-46a2-8e43-ccca9deba73e tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] 10.222.0.25 "GET /compute/v2.1/servers/7949b4da-6f1f-407b-ae66-6469b930574f" status: 200 len: 1318 microversion: 2.1 time: 0.146893 Sep 25 04:51:20.074720 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 575/1220] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:51:19 2022] GET /compute/v2.1/servers/7949b4da-6f1f-407b-ae66-6469b930574f => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:51:20.583911 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-a546efcd-ea26-4159-b189-d3df373b7c47 req-381aa06c-3f7a-4a5e-8c3b-3b8c1cb2a0f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7949b4da-6f1f-407b-ae66-6469b930574f", "name": "network-vif-plugged", "status": "completed", "tag": "82c314f0-90e1-4a31-9545-0725576fe7dd"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:51:20.595439 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-a546efcd-ea26-4159-b189-d3df373b7c47 req-381aa06c-3f7a-4a5e-8c3b-3b8c1cb2a0f2 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:51:20.596043 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-a546efcd-ea26-4159-b189-d3df373b7c47 req-381aa06c-3f7a-4a5e-8c3b-3b8c1cb2a0f2 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:51:20.597154 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-a546efcd-ea26-4159-b189-d3df373b7c47 req-381aa06c-3f7a-4a5e-8c3b-3b8c1cb2a0f2 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:51:20.609489 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-a546efcd-ea26-4159-b189-d3df373b7c47 req-381aa06c-3f7a-4a5e-8c3b-3b8c1cb2a0f2 service nova] Creating event network-vif-plugged:82c314f0-90e1-4a31-9545-0725576fe7dd for instance 7949b4da-6f1f-407b-ae66-6469b930574f on hv-cinder-85535 Sep 25 04:51:20.614624 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-a546efcd-ea26-4159-b189-d3df373b7c47 req-381aa06c-3f7a-4a5e-8c3b-3b8c1cb2a0f2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034346 Sep 25 04:51:20.615412 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 646/1221] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:51:21.098315 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-9dadd286-e3d1-42c1-a21c-77a90c34d854 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:51:21.098929 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-9dadd286-e3d1-42c1-a21c-77a90c34d854 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] [instance: 7949b4da-6f1f-407b-ae66-6469b930574f] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:51:21.105443 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9dadd286-e3d1-42c1-a21c-77a90c34d854 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:51:21.105932 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9dadd286-e3d1-42c1-a21c-77a90c34d854 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:51:21.106368 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9dadd286-e3d1-42c1-a21c-77a90c34d854 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:51:21.107057 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9dadd286-e3d1-42c1-a21c-77a90c34d854 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:51:21.107512 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9dadd286-e3d1-42c1-a21c-77a90c34d854 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:51:21.107939 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-9dadd286-e3d1-42c1-a21c-77a90c34d854 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:51:21.236390 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-9dadd286-e3d1-42c1-a21c-77a90c34d854 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c481f7a811a438e809b3bb8a8e4c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38de016089e0474d9a2b16cfecaf0a60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:51:21.244303 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-9dadd286-e3d1-42c1-a21c-77a90c34d854 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] 10.222.0.25 "GET /compute/v2.1/servers/7949b4da-6f1f-407b-ae66-6469b930574f" status: 200 len: 1318 microversion: 2.1 time: 0.149867 Sep 25 04:51:21.244911 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 576/1222] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:51:21 2022] GET /compute/v2.1/servers/7949b4da-6f1f-407b-ae66-6469b930574f => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:51:22.269225 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-52091439-c3aa-4508-9ded-eaf5e24848ac tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:51:22.270096 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-52091439-c3aa-4508-9ded-eaf5e24848ac tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] [instance: 7949b4da-6f1f-407b-ae66-6469b930574f] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:51:22.276945 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-52091439-c3aa-4508-9ded-eaf5e24848ac tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:51:22.277433 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-52091439-c3aa-4508-9ded-eaf5e24848ac tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:51:22.277881 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-52091439-c3aa-4508-9ded-eaf5e24848ac tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:51:22.278582 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-52091439-c3aa-4508-9ded-eaf5e24848ac tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:51:22.279041 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-52091439-c3aa-4508-9ded-eaf5e24848ac tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:51:22.279473 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-52091439-c3aa-4508-9ded-eaf5e24848ac tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:51:22.423389 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-52091439-c3aa-4508-9ded-eaf5e24848ac tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c481f7a811a438e809b3bb8a8e4c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38de016089e0474d9a2b16cfecaf0a60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:51:22.434116 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-52091439-c3aa-4508-9ded-eaf5e24848ac tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] 10.222.0.25 "GET /compute/v2.1/servers/7949b4da-6f1f-407b-ae66-6469b930574f" status: 200 len: 1508 microversion: 2.1 time: 0.168936 Sep 25 04:51:22.434943 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 647/1223] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:51:22 2022] GET /compute/v2.1/servers/7949b4da-6f1f-407b-ae66-6469b930574f => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:51:22.468942 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-68a16177-37ff-402c-989b-6d8764ce7ec7 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86ff4cd2-3416-41a0-a6e6-f3f2e5138cf3", "device": "/dev/sdb"}} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:51:22.471636 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-68a16177-37ff-402c-989b-6d8764ce7ec7 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] [instance: 7949b4da-6f1f-407b-ae66-6469b930574f] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:51:22.480264 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-68a16177-37ff-402c-989b-6d8764ce7ec7 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:51:22.481268 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-68a16177-37ff-402c-989b-6d8764ce7ec7 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:51:22.481969 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-68a16177-37ff-402c-989b-6d8764ce7ec7 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:51:22.483062 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-68a16177-37ff-402c-989b-6d8764ce7ec7 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:51:22.483778 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-68a16177-37ff-402c-989b-6d8764ce7ec7 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:51:22.484472 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-68a16177-37ff-402c-989b-6d8764ce7ec7 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:51:22.839863 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-68a16177-37ff-402c-989b-6d8764ce7ec7 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] 10.222.0.25 "POST /compute/v2.1/servers/7949b4da-6f1f-407b-ae66-6469b930574f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.375681 Sep 25 04:51:22.842899 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 577/1224] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Sep 25 04:51:22 2022] POST /compute/v2.1/servers/7949b4da-6f1f-407b-ae66-6469b930574f/os-volume_attachments => generated 194 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:51:44.294881 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-667bbfcf-cdc4-4a13-ad03-2efe97562cae tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:51:44.295418 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-667bbfcf-cdc4-4a13-ad03-2efe97562cae tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] [instance: 7949b4da-6f1f-407b-ae66-6469b930574f] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:51:44.297884 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell0:SELECT=2 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:51:44.298578 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_api:SELECT=14 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:51:44.299432 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=26 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:51:44.301098 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 25 04:51:44.301247 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Sun Sep 25 04:51:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7949b4da-6f1f-407b-ae66-6469b930574f/os-volume_attachments/86ff4cd2-3416-41a0-a6e6-f3f2e5138cf3 (ip 10.222.0.25) !!! Sep 25 04:51:44.309479 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-667bbfcf-cdc4-4a13-ad03-2efe97562cae tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:51:44.309956 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-667bbfcf-cdc4-4a13-ad03-2efe97562cae tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:51:44.310385 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-667bbfcf-cdc4-4a13-ad03-2efe97562cae tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:51:44.311069 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-667bbfcf-cdc4-4a13-ad03-2efe97562cae tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:51:44.311516 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-667bbfcf-cdc4-4a13-ad03-2efe97562cae tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:51:44.311934 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-667bbfcf-cdc4-4a13-ad03-2efe97562cae tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:51:44.392074 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.objects.instance [None req-667bbfcf-cdc4-4a13-ad03-2efe97562cae tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lazy-loading 'services' on Instance uuid 7949b4da-6f1f-407b-ae66-6469b930574f {{(pid=127142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 04:51:44.462615 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-667bbfcf-cdc4-4a13-ad03-2efe97562cae tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7949b4da-6f1f-407b-ae66-6469b930574f/os-volume_attachments/86ff4cd2-3416-41a0-a6e6-f3f2e5138cf3" status: 202 len: 0 microversion: 2.1 time: 0.171579 Sep 25 04:51:44.463224 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 648/1225] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Sep 25 04:51:44 2022] DELETE /compute/v2.1/servers/7949b4da-6f1f-407b-ae66-6469b930574f/os-volume_attachments/86ff4cd2-3416-41a0-a6e6-f3f2e5138cf3 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 04:51:45.585654 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell0:SELECT=2 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:51:45.586419 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell0:SELECT=6 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:51:45.587364 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:51:45.588225 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:51:45.589782 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 25 04:51:45.589928 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Sun Sep 25 04:51:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7949b4da-6f1f-407b-ae66-6469b930574f (ip 10.222.0.25) !!! Sep 25 04:51:45.596659 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-76a33b05-261b-4060-84f5-7b2987238d46 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:51:45.597304 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-76a33b05-261b-4060-84f5-7b2987238d46 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] [instance: 7949b4da-6f1f-407b-ae66-6469b930574f] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:51:45.612832 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-76a33b05-261b-4060-84f5-7b2987238d46 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:51:45.613323 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-76a33b05-261b-4060-84f5-7b2987238d46 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:51:45.613763 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-76a33b05-261b-4060-84f5-7b2987238d46 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:51:45.614461 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-76a33b05-261b-4060-84f5-7b2987238d46 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:51:45.614919 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-76a33b05-261b-4060-84f5-7b2987238d46 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:51:45.615349 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-76a33b05-261b-4060-84f5-7b2987238d46 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:51:45.642068 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-76a33b05-261b-4060-84f5-7b2987238d46 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] [instance: 7949b4da-6f1f-407b-ae66-6469b930574f] Going to try to terminate instance {{(pid=127141) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 04:51:45.717458 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-76a33b05-261b-4060-84f5-7b2987238d46 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7949b4da-6f1f-407b-ae66-6469b930574f" status: 204 len: 0 microversion: 2.1 time: 0.132572 Sep 25 04:51:45.718149 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 578/1226] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 25 04:51:45 2022] DELETE /compute/v2.1/servers/7949b4da-6f1f-407b-ae66-6469b930574f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 04:51:45.728361 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-d59c8112-182c-4ed0-92b2-5f62b05fe430 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:51:45.729098 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-d59c8112-182c-4ed0-92b2-5f62b05fe430 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] [instance: 7949b4da-6f1f-407b-ae66-6469b930574f] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:51:45.735487 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d59c8112-182c-4ed0-92b2-5f62b05fe430 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:51:45.736007 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d59c8112-182c-4ed0-92b2-5f62b05fe430 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:51:45.736446 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d59c8112-182c-4ed0-92b2-5f62b05fe430 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:51:45.737166 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d59c8112-182c-4ed0-92b2-5f62b05fe430 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:51:45.737627 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d59c8112-182c-4ed0-92b2-5f62b05fe430 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:51:45.738055 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-d59c8112-182c-4ed0-92b2-5f62b05fe430 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:51:45.870181 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-d59c8112-182c-4ed0-92b2-5f62b05fe430 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c481f7a811a438e809b3bb8a8e4c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38de016089e0474d9a2b16cfecaf0a60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:51:45.878200 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-d59c8112-182c-4ed0-92b2-5f62b05fe430 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] 10.222.0.25 "GET /compute/v2.1/servers/7949b4da-6f1f-407b-ae66-6469b930574f" status: 200 len: 1514 microversion: 2.1 time: 0.154578 Sep 25 04:51:45.878765 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 649/1227] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:51:45 2022] GET /compute/v2.1/servers/7949b4da-6f1f-407b-ae66-6469b930574f => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:51:46.904071 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-7ecca379-e428-4e44-a543-111590c5f7d4 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:51:46.905205 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-7ecca379-e428-4e44-a543-111590c5f7d4 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] [instance: 7949b4da-6f1f-407b-ae66-6469b930574f] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:51:46.916229 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7ecca379-e428-4e44-a543-111590c5f7d4 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:51:46.917170 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7ecca379-e428-4e44-a543-111590c5f7d4 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:51:46.917920 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7ecca379-e428-4e44-a543-111590c5f7d4 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:51:46.918938 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7ecca379-e428-4e44-a543-111590c5f7d4 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:51:46.919412 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7ecca379-e428-4e44-a543-111590c5f7d4 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:51:46.919848 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7ecca379-e428-4e44-a543-111590c5f7d4 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:51:47.050179 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-7ecca379-e428-4e44-a543-111590c5f7d4 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c481f7a811a438e809b3bb8a8e4c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38de016089e0474d9a2b16cfecaf0a60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:51:47.057752 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-7ecca379-e428-4e44-a543-111590c5f7d4 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] 10.222.0.25 "GET /compute/v2.1/servers/7949b4da-6f1f-407b-ae66-6469b930574f" status: 200 len: 1514 microversion: 2.1 time: 0.159203 Sep 25 04:51:47.058317 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 579/1228] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:51:46 2022] GET /compute/v2.1/servers/7949b4da-6f1f-407b-ae66-6469b930574f => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:51:48.081905 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-da8f1a13-39ff-45e3-af21-e2f628966939 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:51:48.082500 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-da8f1a13-39ff-45e3-af21-e2f628966939 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] [instance: 7949b4da-6f1f-407b-ae66-6469b930574f] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:51:48.089372 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-da8f1a13-39ff-45e3-af21-e2f628966939 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:51:48.089867 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-da8f1a13-39ff-45e3-af21-e2f628966939 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:51:48.090311 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-da8f1a13-39ff-45e3-af21-e2f628966939 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:51:48.091019 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-da8f1a13-39ff-45e3-af21-e2f628966939 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:51:48.091474 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-da8f1a13-39ff-45e3-af21-e2f628966939 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:51:48.091908 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-da8f1a13-39ff-45e3-af21-e2f628966939 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:51:48.301846 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-da8f1a13-39ff-45e3-af21-e2f628966939 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c481f7a811a438e809b3bb8a8e4c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38de016089e0474d9a2b16cfecaf0a60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:51:48.309873 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-da8f1a13-39ff-45e3-af21-e2f628966939 tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] 10.222.0.25 "GET /compute/v2.1/servers/7949b4da-6f1f-407b-ae66-6469b930574f" status: 200 len: 1514 microversion: 2.1 time: 0.232576 Sep 25 04:51:48.310446 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 650/1229] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:51:48 2022] GET /compute/v2.1/servers/7949b4da-6f1f-407b-ae66-6469b930574f => generated 1514 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:51:48.444802 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [req-3a4d7f12-8dad-4514-a3aa-c18e2589bbc1 req-80cf4b7d-2e73-40a2-a6bc-f424e18fa935 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7949b4da-6f1f-407b-ae66-6469b930574f", "name": "network-vif-deleted", "tag": "82c314f0-90e1-4a31-9545-0725576fe7dd"}]} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:51:48.455822 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-3a4d7f12-8dad-4514-a3aa-c18e2589bbc1 req-80cf4b7d-2e73-40a2-a6bc-f424e18fa935 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:51:48.456295 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-3a4d7f12-8dad-4514-a3aa-c18e2589bbc1 req-80cf4b7d-2e73-40a2-a6bc-f424e18fa935 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:51:48.456752 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [req-3a4d7f12-8dad-4514-a3aa-c18e2589bbc1 req-80cf4b7d-2e73-40a2-a6bc-f424e18fa935 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:51:48.469115 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.compute.server_external_events [req-3a4d7f12-8dad-4514-a3aa-c18e2589bbc1 req-80cf4b7d-2e73-40a2-a6bc-f424e18fa935 service nova] Creating event network-vif-deleted:82c314f0-90e1-4a31-9545-0725576fe7dd for instance 7949b4da-6f1f-407b-ae66-6469b930574f on hv-cinder-85535 Sep 25 04:51:48.475767 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [req-3a4d7f12-8dad-4514-a3aa-c18e2589bbc1 req-80cf4b7d-2e73-40a2-a6bc-f424e18fa935 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034700 Sep 25 04:51:48.476375 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 580/1230] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:51:49.334391 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-746da884-cefa-4acc-b410-f6a6ccd887ba tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:51:49.334955 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-746da884-cefa-4acc-b410-f6a6ccd887ba tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] [instance: 7949b4da-6f1f-407b-ae66-6469b930574f] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:51:49.341720 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-746da884-cefa-4acc-b410-f6a6ccd887ba tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:51:49.342196 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-746da884-cefa-4acc-b410-f6a6ccd887ba tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:51:49.342628 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-746da884-cefa-4acc-b410-f6a6ccd887ba tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:51:49.343310 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-746da884-cefa-4acc-b410-f6a6ccd887ba tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:51:49.344067 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-746da884-cefa-4acc-b410-f6a6ccd887ba tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:51:49.344493 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-746da884-cefa-4acc-b410-f6a6ccd887ba tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:51:49.357397 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.wsgi [None req-746da884-cefa-4acc-b410-f6a6ccd887ba tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] HTTP exception thrown: Instance 7949b4da-6f1f-407b-ae66-6469b930574f could not be found. Sep 25 04:51:49.359567 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-746da884-cefa-4acc-b410-f6a6ccd887ba tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Request method failure captured: Sep 25 04:51:49.359567 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: request: GET /compute/v2.1/servers/7949b4da-6f1f-407b-ae66-6469b930574f HTTP/1.1 Sep 25 04:51:49.359567 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept: application/json Sep 25 04:51:49.359567 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept-Encoding: identity Sep 25 04:51:49.359567 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Connection: close Sep 25 04:51:49.359567 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Length: 0 Sep 25 04:51:49.359567 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Type: application/json Sep 25 04:51:49.359567 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Host: 10.222.0.25 Sep 25 04:51:49.359567 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Openstack-System-Scope: None Sep 25 04:51:49.359567 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: User-Agent: python-urllib3/1.26.12 Sep 25 04:51:49.359567 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Auth-Token: gAAAAABjL93xtd50VlhJXADAdRQlk2dag9GRbPbFL7pDHrU19D1a3HZ0pgFZ-EYwuL7MYvT6mgwxoB421aDRLYlTeeT-7TX4tEI0-lmKI5deRVv-WEZQNDKqjeLKBFGrU_wHh8ZDIQpYHlZgq21wKm9mMaoz50bYtKFENe7qu-BO3wax1Dko4Zs Sep 25 04:51:49.359567 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Id: None Sep 25 04:51:49.359567 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Name: None Sep 25 04:51:49.359567 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Identity-Status: Confirmed Sep 25 04:51:49.359567 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Is-Admin-Project: True Sep 25 04:51:49.359567 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Id: default Sep 25 04:51:49.359567 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Name: Default Sep 25 04:51:49.359567 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Id: 38de016089e0474d9a2b16cfecaf0a60 Sep 25 04:51:49.359567 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1053816945 Sep 25 04:51:49.359567 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Role: reader,member Sep 25 04:51:49.359567 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Roles: reader,member Sep 25 04:51:49.361751 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/38de016089e0474d9a2b16cfecaf0a60"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38de016089e0474d9a2b16cfecaf0a60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38de016089e0474d9a2b16cfecaf0a60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_38de016089e0474d9a2b16cfecaf0a60"}]}] Sep 25 04:51:49.361751 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant: tempest-VolumesSnapshotTestJSON-1053816945 Sep 25 04:51:49.361751 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Id: 38de016089e0474d9a2b16cfecaf0a60 Sep 25 04:51:49.361751 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1053816945 Sep 25 04:51:49.361751 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User: tempest-VolumesSnapshotTestJSON-1053816945-project Sep 25 04:51:49.361751 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Id: default Sep 25 04:51:49.361751 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Name: Default Sep 25 04:51:49.361751 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Id: 0c481f7a811a438e809b3bb8a8e4c127 Sep 25 04:51:49.361751 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Name: tempest-VolumesSnapshotTestJSON-1053816945-project Sep 25 04:51:49.361751 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: method: > Sep 25 04:51:49.361751 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: exception: Instance 7949b4da-6f1f-407b-ae66-6469b930574f could not be found. Sep 25 04:51:49.361751 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: action_args: {'id': '7949b4da-6f1f-407b-ae66-6469b930574f'} Sep 25 04:51:49.362851 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:51:49.362851 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:51:49.362851 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:51:49.362851 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:51:49.362851 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:51:49.362851 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:51:49.362851 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:51:49.362851 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:51:49.362851 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:51:49.362851 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:51:49.362851 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7949b4da-6f1f-407b-ae66-6469b930574f could not be found. Sep 25 04:51:49.362851 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:51:49.362851 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:51:49.362851 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:51:49.362851 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:51:49.362851 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:51:49.362851 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:51:49.362851 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:51:49.362851 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:51:49.362851 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:51:49.364608 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:51:49.364608 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 04:51:49.364608 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 04:51:49.364608 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:51:49.364608 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:51:49.364608 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:51:49.364608 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:51:49.364608 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7949b4da-6f1f-407b-ae66-6469b930574f could not be found. Sep 25 04:51:49.364608 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:51:49.364608 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:51:49.364608 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:51:49.364608 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:51:49.364608 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:51:49.364608 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:51:49.364608 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:51:49.364608 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:51:49.364608 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7949b4da-6f1f-407b-ae66-6469b930574f could not be found. Sep 25 04:51:49.364608 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:51:49.366352 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-746da884-cefa-4acc-b410-f6a6ccd887ba tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] Returning 404 to user: Instance 7949b4da-6f1f-407b-ae66-6469b930574f could not be found. {{(pid=127142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:51:49.366352 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-746da884-cefa-4acc-b410-f6a6ccd887ba tempest-VolumesSnapshotTestJSON-1053816945 tempest-VolumesSnapshotTestJSON-1053816945-project] 10.222.0.25 "GET /compute/v2.1/servers/7949b4da-6f1f-407b-ae66-6469b930574f" status: 404 len: 111 microversion: 2.1 time: 0.030627 Sep 25 04:51:49.366352 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 651/1231] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:51:49 2022] GET /compute/v2.1/servers/7949b4da-6f1f-407b-ae66-6469b930574f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 04:52:15.925297 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:52:15.926050 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:52:15.930358 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-6bedb412-507f-41d2-92a6-2ae38b988028 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:52:15.930975 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-6bedb412-507f-41d2-92a6-2ae38b988028 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:52:15.939194 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6bedb412-507f-41d2-92a6-2ae38b988028 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:15.939676 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6bedb412-507f-41d2-92a6-2ae38b988028 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:15.940137 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6bedb412-507f-41d2-92a6-2ae38b988028 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:15.940857 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6bedb412-507f-41d2-92a6-2ae38b988028 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:15.941313 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6bedb412-507f-41d2-92a6-2ae38b988028 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:15.941738 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6bedb412-507f-41d2-92a6-2ae38b988028 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:15.966081 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.objects.instance [None req-6bedb412-507f-41d2-92a6-2ae38b988028 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lazy-loading 'flavor' on Instance uuid fe8e79dd-3c8b-432d-aee1-0ca947d8affe {{(pid=127141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 04:52:16.037191 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-6bedb412-507f-41d2-92a6-2ae38b988028 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "POST /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe/action" status: 202 len: 0 microversion: 2.1 time: 0.113257 Sep 25 04:52:16.037770 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 581/1232] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 25 04:52:15 2022] POST /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 04:52:16.046246 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-2c81e541-f79d-46ee-bfd0-993da7a3d50a tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:52:16.047064 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-2c81e541-f79d-46ee-bfd0-993da7a3d50a tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:52:16.049297 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_api:SELECT=8 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:52:16.050082 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:52:16.055807 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2c81e541-f79d-46ee-bfd0-993da7a3d50a tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:16.056290 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2c81e541-f79d-46ee-bfd0-993da7a3d50a tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:16.056749 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2c81e541-f79d-46ee-bfd0-993da7a3d50a tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:16.057440 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2c81e541-f79d-46ee-bfd0-993da7a3d50a tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:16.057885 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2c81e541-f79d-46ee-bfd0-993da7a3d50a tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:16.058302 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2c81e541-f79d-46ee-bfd0-993da7a3d50a tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:16.195970 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-2c81e541-f79d-46ee-bfd0-993da7a3d50a tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:52:16.204591 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-2c81e541-f79d-46ee-bfd0-993da7a3d50a tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1568 microversion: 2.1 time: 0.162284 Sep 25 04:52:16.205174 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 652/1233] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:52:16 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:52:17.230031 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-1942338c-1a60-4d4e-aa66-0ff870516d69 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:52:17.230725 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-1942338c-1a60-4d4e-aa66-0ff870516d69 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:52:17.236909 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1942338c-1a60-4d4e-aa66-0ff870516d69 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:17.237392 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1942338c-1a60-4d4e-aa66-0ff870516d69 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:17.237824 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1942338c-1a60-4d4e-aa66-0ff870516d69 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:17.238540 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1942338c-1a60-4d4e-aa66-0ff870516d69 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:17.238996 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1942338c-1a60-4d4e-aa66-0ff870516d69 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:17.239420 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1942338c-1a60-4d4e-aa66-0ff870516d69 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:17.370288 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-1942338c-1a60-4d4e-aa66-0ff870516d69 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:52:17.378811 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-1942338c-1a60-4d4e-aa66-0ff870516d69 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1568 microversion: 2.1 time: 0.153840 Sep 25 04:52:17.379570 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 582/1234] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:52:17 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:52:18.402407 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-c75259d4-8142-4d1e-a2fd-3d203e8b6025 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:52:18.403157 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-c75259d4-8142-4d1e-a2fd-3d203e8b6025 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:52:18.409761 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c75259d4-8142-4d1e-a2fd-3d203e8b6025 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:18.410237 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c75259d4-8142-4d1e-a2fd-3d203e8b6025 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:18.410666 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c75259d4-8142-4d1e-a2fd-3d203e8b6025 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:18.411342 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c75259d4-8142-4d1e-a2fd-3d203e8b6025 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:18.411786 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c75259d4-8142-4d1e-a2fd-3d203e8b6025 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:18.412201 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c75259d4-8142-4d1e-a2fd-3d203e8b6025 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:18.545336 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-c75259d4-8142-4d1e-a2fd-3d203e8b6025 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:52:18.553585 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-c75259d4-8142-4d1e-a2fd-3d203e8b6025 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1568 microversion: 2.1 time: 0.155105 Sep 25 04:52:18.554151 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 653/1235] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:52:18 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:52:19.578152 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-c2b07c69-c037-4d85-b805-9116f98f429e tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:52:19.578764 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-c2b07c69-c037-4d85-b805-9116f98f429e tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:52:19.585068 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c2b07c69-c037-4d85-b805-9116f98f429e tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:19.585585 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c2b07c69-c037-4d85-b805-9116f98f429e tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:19.586024 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c2b07c69-c037-4d85-b805-9116f98f429e tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:19.586747 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c2b07c69-c037-4d85-b805-9116f98f429e tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:19.587209 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c2b07c69-c037-4d85-b805-9116f98f429e tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:19.587638 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-c2b07c69-c037-4d85-b805-9116f98f429e tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:19.718023 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-c2b07c69-c037-4d85-b805-9116f98f429e tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:52:19.726823 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-c2b07c69-c037-4d85-b805-9116f98f429e tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1568 microversion: 2.1 time: 0.152794 Sep 25 04:52:19.727386 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 583/1236] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:52:19 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:52:20.750929 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-f2d16eda-fa73-400b-acd2-5e0d34b292b2 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:52:20.751478 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-f2d16eda-fa73-400b-acd2-5e0d34b292b2 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:52:20.757908 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f2d16eda-fa73-400b-acd2-5e0d34b292b2 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:20.758389 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f2d16eda-fa73-400b-acd2-5e0d34b292b2 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:20.758827 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f2d16eda-fa73-400b-acd2-5e0d34b292b2 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:20.759509 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f2d16eda-fa73-400b-acd2-5e0d34b292b2 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:20.759964 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f2d16eda-fa73-400b-acd2-5e0d34b292b2 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:20.760387 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-f2d16eda-fa73-400b-acd2-5e0d34b292b2 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:20.889088 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-f2d16eda-fa73-400b-acd2-5e0d34b292b2 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:52:20.897663 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-f2d16eda-fa73-400b-acd2-5e0d34b292b2 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1568 microversion: 2.1 time: 0.150939 Sep 25 04:52:20.898218 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 654/1237] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:52:20 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:52:21.921502 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-01ded821-a25e-4585-8d20-f8ec10eb3a2c tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:52:21.922230 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-01ded821-a25e-4585-8d20-f8ec10eb3a2c tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:52:21.928625 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-01ded821-a25e-4585-8d20-f8ec10eb3a2c tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:21.929149 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-01ded821-a25e-4585-8d20-f8ec10eb3a2c tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:21.929583 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-01ded821-a25e-4585-8d20-f8ec10eb3a2c tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:21.930276 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-01ded821-a25e-4585-8d20-f8ec10eb3a2c tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:21.930765 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-01ded821-a25e-4585-8d20-f8ec10eb3a2c tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:21.931192 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-01ded821-a25e-4585-8d20-f8ec10eb3a2c tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:22.063344 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-01ded821-a25e-4585-8d20-f8ec10eb3a2c tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:52:22.071076 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-01ded821-a25e-4585-8d20-f8ec10eb3a2c tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1568 microversion: 2.1 time: 0.153533 Sep 25 04:52:22.071639 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 584/1238] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:52:21 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:52:23.096569 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-5782380a-6919-473d-a695-580b8c040e32 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:52:23.097210 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-5782380a-6919-473d-a695-580b8c040e32 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:52:23.103575 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5782380a-6919-473d-a695-580b8c040e32 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:23.104442 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5782380a-6919-473d-a695-580b8c040e32 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:23.104570 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5782380a-6919-473d-a695-580b8c040e32 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:23.105195 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5782380a-6919-473d-a695-580b8c040e32 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:23.105651 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5782380a-6919-473d-a695-580b8c040e32 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:23.106074 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5782380a-6919-473d-a695-580b8c040e32 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:23.234337 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-5782380a-6919-473d-a695-580b8c040e32 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:52:23.242032 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-5782380a-6919-473d-a695-580b8c040e32 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1568 microversion: 2.1 time: 0.150108 Sep 25 04:52:23.242595 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 655/1239] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:52:23 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:52:24.265434 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-1abb51cb-bbd4-4223-9bc1-4e7804f0f3a2 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:52:24.266100 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-1abb51cb-bbd4-4223-9bc1-4e7804f0f3a2 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:52:24.272724 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1abb51cb-bbd4-4223-9bc1-4e7804f0f3a2 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:24.273212 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1abb51cb-bbd4-4223-9bc1-4e7804f0f3a2 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:24.273666 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1abb51cb-bbd4-4223-9bc1-4e7804f0f3a2 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:24.274328 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1abb51cb-bbd4-4223-9bc1-4e7804f0f3a2 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:24.274775 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1abb51cb-bbd4-4223-9bc1-4e7804f0f3a2 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:24.275198 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-1abb51cb-bbd4-4223-9bc1-4e7804f0f3a2 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:24.408458 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-1abb51cb-bbd4-4223-9bc1-4e7804f0f3a2 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:52:24.416089 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-1abb51cb-bbd4-4223-9bc1-4e7804f0f3a2 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1568 microversion: 2.1 time: 0.154683 Sep 25 04:52:24.416655 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 585/1240] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:52:24 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:52:25.439659 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-c0bbca4f-ad53-40bc-91b3-1d0d182933ba tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:52:25.440267 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-c0bbca4f-ad53-40bc-91b3-1d0d182933ba tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:52:25.446729 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c0bbca4f-ad53-40bc-91b3-1d0d182933ba tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:25.447208 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c0bbca4f-ad53-40bc-91b3-1d0d182933ba tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:25.447644 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c0bbca4f-ad53-40bc-91b3-1d0d182933ba tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:25.448328 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c0bbca4f-ad53-40bc-91b3-1d0d182933ba tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:25.448807 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c0bbca4f-ad53-40bc-91b3-1d0d182933ba tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:25.449231 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c0bbca4f-ad53-40bc-91b3-1d0d182933ba tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:25.578560 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-c0bbca4f-ad53-40bc-91b3-1d0d182933ba tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:52:25.586242 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-c0bbca4f-ad53-40bc-91b3-1d0d182933ba tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1568 microversion: 2.1 time: 0.150848 Sep 25 04:52:25.586800 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 656/1241] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:52:25 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:52:26.610366 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-6c74fa56-33dd-4cf0-bde0-a609707db312 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:52:26.611026 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-6c74fa56-33dd-4cf0-bde0-a609707db312 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:52:26.617596 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6c74fa56-33dd-4cf0-bde0-a609707db312 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:26.618078 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6c74fa56-33dd-4cf0-bde0-a609707db312 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:26.618508 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6c74fa56-33dd-4cf0-bde0-a609707db312 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:26.619197 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6c74fa56-33dd-4cf0-bde0-a609707db312 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:26.619650 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6c74fa56-33dd-4cf0-bde0-a609707db312 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:26.620071 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-6c74fa56-33dd-4cf0-bde0-a609707db312 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:26.843867 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-6c74fa56-33dd-4cf0-bde0-a609707db312 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:52:26.852392 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-6c74fa56-33dd-4cf0-bde0-a609707db312 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1568 microversion: 2.1 time: 0.246700 Sep 25 04:52:26.853333 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 586/1242] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:52:26 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1568 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:52:27.876694 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-2533b9be-36a6-41b4-b2b1-77d763aaab9b tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:52:27.877224 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-2533b9be-36a6-41b4-b2b1-77d763aaab9b tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:52:27.883338 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2533b9be-36a6-41b4-b2b1-77d763aaab9b tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:27.883822 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2533b9be-36a6-41b4-b2b1-77d763aaab9b tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:27.884260 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2533b9be-36a6-41b4-b2b1-77d763aaab9b tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:27.885179 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2533b9be-36a6-41b4-b2b1-77d763aaab9b tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:27.885636 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2533b9be-36a6-41b4-b2b1-77d763aaab9b tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:27.886062 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-2533b9be-36a6-41b4-b2b1-77d763aaab9b tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:28.015708 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-2533b9be-36a6-41b4-b2b1-77d763aaab9b tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:52:28.023554 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-2533b9be-36a6-41b4-b2b1-77d763aaab9b tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1568 microversion: 2.1 time: 0.151086 Sep 25 04:52:28.024118 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 657/1243] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:52:27 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:52:29.047792 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-ea3ce56f-863b-4559-bd71-fda34a97a8ec tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:52:29.048334 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-ea3ce56f-863b-4559-bd71-fda34a97a8ec tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:52:29.054981 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ea3ce56f-863b-4559-bd71-fda34a97a8ec tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:29.055470 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ea3ce56f-863b-4559-bd71-fda34a97a8ec tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:29.055909 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ea3ce56f-863b-4559-bd71-fda34a97a8ec tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:29.056609 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ea3ce56f-863b-4559-bd71-fda34a97a8ec tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:29.057093 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ea3ce56f-863b-4559-bd71-fda34a97a8ec tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:29.057532 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ea3ce56f-863b-4559-bd71-fda34a97a8ec tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:29.186616 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-ea3ce56f-863b-4559-bd71-fda34a97a8ec tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:52:29.194598 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-ea3ce56f-863b-4559-bd71-fda34a97a8ec tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1569 microversion: 2.1 time: 0.151273 Sep 25 04:52:29.195165 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 587/1244] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:52:29 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:52:29.218869 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-774c55c8-752f-4ceb-80d5-c432093e4b02 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:52:29.219673 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-774c55c8-752f-4ceb-80d5-c432093e4b02 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:52:29.226293 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-774c55c8-752f-4ceb-80d5-c432093e4b02 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:29.226785 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-774c55c8-752f-4ceb-80d5-c432093e4b02 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:29.227225 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-774c55c8-752f-4ceb-80d5-c432093e4b02 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:29.227926 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-774c55c8-752f-4ceb-80d5-c432093e4b02 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:29.228388 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-774c55c8-752f-4ceb-80d5-c432093e4b02 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:29.228880 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-774c55c8-752f-4ceb-80d5-c432093e4b02 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:29.269927 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-774c55c8-752f-4ceb-80d5-c432093e4b02 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127142) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 25 04:52:29.343767 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-774c55c8-752f-4ceb-80d5-c432093e4b02 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "POST /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe/action" status: 202 len: 0 microversion: 2.1 time: 0.129826 Sep 25 04:52:29.344854 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 658/1245] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Sep 25 04:52:29 2022] POST /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 04:52:29.352662 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-3c953cee-7769-406a-8be2-9dd19e2920e7 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:52:29.353372 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-3c953cee-7769-406a-8be2-9dd19e2920e7 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:52:29.360403 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3c953cee-7769-406a-8be2-9dd19e2920e7 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:29.361232 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3c953cee-7769-406a-8be2-9dd19e2920e7 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:29.363061 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3c953cee-7769-406a-8be2-9dd19e2920e7 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:29.363061 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3c953cee-7769-406a-8be2-9dd19e2920e7 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:29.363330 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3c953cee-7769-406a-8be2-9dd19e2920e7 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:29.363967 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-3c953cee-7769-406a-8be2-9dd19e2920e7 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:29.504931 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-3c953cee-7769-406a-8be2-9dd19e2920e7 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:52:29.512587 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-3c953cee-7769-406a-8be2-9dd19e2920e7 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1517 microversion: 2.1 time: 0.163813 Sep 25 04:52:29.513180 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 588/1246] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:52:29 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:52:30.537075 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-c069b348-2517-4f82-b5c0-0a029ac57d95 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:52:30.537686 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-c069b348-2517-4f82-b5c0-0a029ac57d95 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:52:30.543695 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c069b348-2517-4f82-b5c0-0a029ac57d95 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:30.544175 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c069b348-2517-4f82-b5c0-0a029ac57d95 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:30.544609 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c069b348-2517-4f82-b5c0-0a029ac57d95 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:30.545319 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c069b348-2517-4f82-b5c0-0a029ac57d95 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:30.545769 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c069b348-2517-4f82-b5c0-0a029ac57d95 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:30.546790 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-c069b348-2517-4f82-b5c0-0a029ac57d95 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:30.680253 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-c069b348-2517-4f82-b5c0-0a029ac57d95 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:52:30.688042 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-c069b348-2517-4f82-b5c0-0a029ac57d95 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1517 microversion: 2.1 time: 0.155400 Sep 25 04:52:30.688605 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 659/1247] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:52:30 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:52:31.711363 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-eeece8c0-36ba-4ff5-abb0-d020f4bfae05 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:52:31.712010 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-eeece8c0-36ba-4ff5-abb0-d020f4bfae05 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:52:31.718833 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-eeece8c0-36ba-4ff5-abb0-d020f4bfae05 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:31.719314 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-eeece8c0-36ba-4ff5-abb0-d020f4bfae05 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:31.719751 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-eeece8c0-36ba-4ff5-abb0-d020f4bfae05 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:31.720440 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-eeece8c0-36ba-4ff5-abb0-d020f4bfae05 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:31.720924 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-eeece8c0-36ba-4ff5-abb0-d020f4bfae05 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:31.721353 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-eeece8c0-36ba-4ff5-abb0-d020f4bfae05 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:31.864777 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-eeece8c0-36ba-4ff5-abb0-d020f4bfae05 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:52:31.872648 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-eeece8c0-36ba-4ff5-abb0-d020f4bfae05 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1517 microversion: 2.1 time: 0.165210 Sep 25 04:52:31.873426 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 589/1248] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:52:31 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:52:32.829782 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-8448c53f-af61-4e2b-a19c-0b20bb46172f req-ef0ce240-dd24-4bfb-92e1-ca517c1f8c15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe8e79dd-3c8b-432d-aee1-0ca947d8affe", "name": "network-vif-unplugged", "status": "completed", "tag": "2eced77b-cebd-4659-801e-16aa388746bd"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:52:32.840050 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-8448c53f-af61-4e2b-a19c-0b20bb46172f req-ef0ce240-dd24-4bfb-92e1-ca517c1f8c15 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:32.840538 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-8448c53f-af61-4e2b-a19c-0b20bb46172f req-ef0ce240-dd24-4bfb-92e1-ca517c1f8c15 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:32.840999 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-8448c53f-af61-4e2b-a19c-0b20bb46172f req-ef0ce240-dd24-4bfb-92e1-ca517c1f8c15 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:32.852376 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.compute.server_external_events [req-8448c53f-af61-4e2b-a19c-0b20bb46172f req-ef0ce240-dd24-4bfb-92e1-ca517c1f8c15 service nova] Unable to find a host for instance fe8e79dd-3c8b-432d-aee1-0ca947d8affe. Dropping event network-vif-unplugged {{(pid=127142) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 25 04:52:32.853312 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-8448c53f-af61-4e2b-a19c-0b20bb46172f req-ef0ce240-dd24-4bfb-92e1-ca517c1f8c15 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028280 Sep 25 04:52:32.853894 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 660/1249] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 25 04:52:32.896587 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-22ad264e-e5e4-46d5-b39d-2008cc0cffaa tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:52:32.897459 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-22ad264e-e5e4-46d5-b39d-2008cc0cffaa tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:52:32.903884 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-22ad264e-e5e4-46d5-b39d-2008cc0cffaa tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:32.904439 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-22ad264e-e5e4-46d5-b39d-2008cc0cffaa tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:32.904982 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-22ad264e-e5e4-46d5-b39d-2008cc0cffaa tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:32.905959 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-22ad264e-e5e4-46d5-b39d-2008cc0cffaa tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:32.906410 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-22ad264e-e5e4-46d5-b39d-2008cc0cffaa tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:32.906840 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-22ad264e-e5e4-46d5-b39d-2008cc0cffaa tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:33.036378 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-22ad264e-e5e4-46d5-b39d-2008cc0cffaa tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:52:33.044192 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-22ad264e-e5e4-46d5-b39d-2008cc0cffaa tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1517 microversion: 2.1 time: 0.151569 Sep 25 04:52:33.044784 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 590/1250] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:52:32 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:52:34.067373 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-9ea9b487-f6a5-4062-b68f-c63c917b39c9 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:52:34.067972 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-9ea9b487-f6a5-4062-b68f-c63c917b39c9 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:52:34.075070 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9ea9b487-f6a5-4062-b68f-c63c917b39c9 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:34.075559 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9ea9b487-f6a5-4062-b68f-c63c917b39c9 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:34.075999 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9ea9b487-f6a5-4062-b68f-c63c917b39c9 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:34.076771 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9ea9b487-f6a5-4062-b68f-c63c917b39c9 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:34.077840 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9ea9b487-f6a5-4062-b68f-c63c917b39c9 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:34.078593 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-9ea9b487-f6a5-4062-b68f-c63c917b39c9 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:34.213054 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-9ea9b487-f6a5-4062-b68f-c63c917b39c9 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:52:34.221440 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-9ea9b487-f6a5-4062-b68f-c63c917b39c9 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1517 microversion: 2.1 time: 0.158081 Sep 25 04:52:34.221995 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 661/1251] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:52:34 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:52:35.245514 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-ddbc8db7-af2b-4ed7-96d2-34788fe7c1a1 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:52:35.246072 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-ddbc8db7-af2b-4ed7-96d2-34788fe7c1a1 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:52:35.253094 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ddbc8db7-af2b-4ed7-96d2-34788fe7c1a1 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:35.253585 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ddbc8db7-af2b-4ed7-96d2-34788fe7c1a1 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:35.254131 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ddbc8db7-af2b-4ed7-96d2-34788fe7c1a1 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:35.254888 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ddbc8db7-af2b-4ed7-96d2-34788fe7c1a1 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:35.255351 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ddbc8db7-af2b-4ed7-96d2-34788fe7c1a1 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:35.255782 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-ddbc8db7-af2b-4ed7-96d2-34788fe7c1a1 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:35.464396 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-ddbc8db7-af2b-4ed7-96d2-34788fe7c1a1 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:52:35.475896 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-ddbc8db7-af2b-4ed7-96d2-34788fe7c1a1 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1575 microversion: 2.1 time: 0.234337 Sep 25 04:52:35.476457 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 591/1252] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:52:35 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1575 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:52:36.501089 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-5732b5e7-e672-41e5-8b00-fa24a58d29df tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:52:36.501721 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-5732b5e7-e672-41e5-8b00-fa24a58d29df tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:52:36.508155 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5732b5e7-e672-41e5-8b00-fa24a58d29df tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:36.508648 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5732b5e7-e672-41e5-8b00-fa24a58d29df tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:36.509091 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5732b5e7-e672-41e5-8b00-fa24a58d29df tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:36.509768 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5732b5e7-e672-41e5-8b00-fa24a58d29df tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:36.510214 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5732b5e7-e672-41e5-8b00-fa24a58d29df tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:36.510639 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-5732b5e7-e672-41e5-8b00-fa24a58d29df tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:36.642666 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-5732b5e7-e672-41e5-8b00-fa24a58d29df tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:52:36.650269 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-5732b5e7-e672-41e5-8b00-fa24a58d29df tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1575 microversion: 2.1 time: 0.153680 Sep 25 04:52:36.650827 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 662/1253] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:52:36 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:52:37.674692 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-67cd3120-0a2d-4b37-9d19-3c1ae9e3ed62 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:52:37.675375 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-67cd3120-0a2d-4b37-9d19-3c1ae9e3ed62 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:52:37.682403 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-67cd3120-0a2d-4b37-9d19-3c1ae9e3ed62 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:37.682894 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-67cd3120-0a2d-4b37-9d19-3c1ae9e3ed62 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:37.683331 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-67cd3120-0a2d-4b37-9d19-3c1ae9e3ed62 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:37.684234 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-67cd3120-0a2d-4b37-9d19-3c1ae9e3ed62 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:37.684535 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-67cd3120-0a2d-4b37-9d19-3c1ae9e3ed62 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:37.684995 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-67cd3120-0a2d-4b37-9d19-3c1ae9e3ed62 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:37.816986 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-67cd3120-0a2d-4b37-9d19-3c1ae9e3ed62 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:52:37.824676 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-67cd3120-0a2d-4b37-9d19-3c1ae9e3ed62 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1575 microversion: 2.1 time: 0.154867 Sep 25 04:52:37.825244 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 592/1254] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:52:37 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:52:38.849497 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-e96700dc-6cce-4bba-aa2b-7f50ce7786df tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:52:38.850117 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-e96700dc-6cce-4bba-aa2b-7f50ce7786df tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:52:38.856688 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e96700dc-6cce-4bba-aa2b-7f50ce7786df tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:38.857177 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e96700dc-6cce-4bba-aa2b-7f50ce7786df tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:38.857615 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e96700dc-6cce-4bba-aa2b-7f50ce7786df tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:38.859021 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e96700dc-6cce-4bba-aa2b-7f50ce7786df tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:38.859484 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e96700dc-6cce-4bba-aa2b-7f50ce7786df tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:38.859910 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-e96700dc-6cce-4bba-aa2b-7f50ce7786df tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:38.990915 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-e96700dc-6cce-4bba-aa2b-7f50ce7786df tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:52:38.998684 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-e96700dc-6cce-4bba-aa2b-7f50ce7786df tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1575 microversion: 2.1 time: 0.153017 Sep 25 04:52:38.999191 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 663/1255] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:52:38 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:52:40.021961 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-2f755eae-7d2a-4ba0-96b7-b57d24b0fbac tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:52:40.022580 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-2f755eae-7d2a-4ba0-96b7-b57d24b0fbac tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:52:40.029101 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2f755eae-7d2a-4ba0-96b7-b57d24b0fbac tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:40.029589 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2f755eae-7d2a-4ba0-96b7-b57d24b0fbac tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:40.030038 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2f755eae-7d2a-4ba0-96b7-b57d24b0fbac tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:40.030751 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2f755eae-7d2a-4ba0-96b7-b57d24b0fbac tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:40.031216 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2f755eae-7d2a-4ba0-96b7-b57d24b0fbac tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:40.031650 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-2f755eae-7d2a-4ba0-96b7-b57d24b0fbac tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:40.162266 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-2f755eae-7d2a-4ba0-96b7-b57d24b0fbac tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:52:40.170123 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-2f755eae-7d2a-4ba0-96b7-b57d24b0fbac tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1575 microversion: 2.1 time: 0.152135 Sep 25 04:52:40.170687 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 593/1256] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:52:40 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:52:41.195291 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-b147fde1-a8ed-42ca-bddc-6578e9b03861 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:52:41.195898 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-b147fde1-a8ed-42ca-bddc-6578e9b03861 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:52:41.202920 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b147fde1-a8ed-42ca-bddc-6578e9b03861 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:41.203573 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b147fde1-a8ed-42ca-bddc-6578e9b03861 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:41.204007 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b147fde1-a8ed-42ca-bddc-6578e9b03861 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:41.204711 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b147fde1-a8ed-42ca-bddc-6578e9b03861 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:41.205158 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b147fde1-a8ed-42ca-bddc-6578e9b03861 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:41.205575 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-b147fde1-a8ed-42ca-bddc-6578e9b03861 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:41.333341 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-b147fde1-a8ed-42ca-bddc-6578e9b03861 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:52:41.341283 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-b147fde1-a8ed-42ca-bddc-6578e9b03861 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1575 microversion: 2.1 time: 0.150004 Sep 25 04:52:41.341840 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 664/1257] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:52:41 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:52:42.364237 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-5f044f60-3b5f-4f52-838e-a3e6fec32da0 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:52:42.364883 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-5f044f60-3b5f-4f52-838e-a3e6fec32da0 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:52:42.371313 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5f044f60-3b5f-4f52-838e-a3e6fec32da0 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:42.371800 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5f044f60-3b5f-4f52-838e-a3e6fec32da0 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:42.372239 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5f044f60-3b5f-4f52-838e-a3e6fec32da0 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:42.372979 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5f044f60-3b5f-4f52-838e-a3e6fec32da0 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:42.373443 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5f044f60-3b5f-4f52-838e-a3e6fec32da0 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:42.373876 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-5f044f60-3b5f-4f52-838e-a3e6fec32da0 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:42.511789 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-5f044f60-3b5f-4f52-838e-a3e6fec32da0 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:52:42.519986 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-5f044f60-3b5f-4f52-838e-a3e6fec32da0 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1575 microversion: 2.1 time: 0.159687 Sep 25 04:52:42.520551 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 594/1258] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:52:42 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:52:43.544114 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-57691279-89c3-4dfd-bf53-4ccf6aa11150 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:52:43.544760 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-57691279-89c3-4dfd-bf53-4ccf6aa11150 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:52:43.550995 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-57691279-89c3-4dfd-bf53-4ccf6aa11150 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:43.551484 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-57691279-89c3-4dfd-bf53-4ccf6aa11150 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:43.551921 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-57691279-89c3-4dfd-bf53-4ccf6aa11150 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:43.552617 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-57691279-89c3-4dfd-bf53-4ccf6aa11150 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:43.553095 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-57691279-89c3-4dfd-bf53-4ccf6aa11150 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:43.553520 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-57691279-89c3-4dfd-bf53-4ccf6aa11150 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:43.687627 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-57691279-89c3-4dfd-bf53-4ccf6aa11150 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:52:43.695926 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-57691279-89c3-4dfd-bf53-4ccf6aa11150 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1575 microversion: 2.1 time: 0.156423 Sep 25 04:52:43.696485 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 665/1259] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:52:43 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:52:44.720093 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-aec3bd74-440f-4867-914b-be68c3cd237c tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:52:44.720743 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-aec3bd74-440f-4867-914b-be68c3cd237c tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:52:44.727164 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-aec3bd74-440f-4867-914b-be68c3cd237c tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:44.727650 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-aec3bd74-440f-4867-914b-be68c3cd237c tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:44.728086 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-aec3bd74-440f-4867-914b-be68c3cd237c tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:44.728807 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-aec3bd74-440f-4867-914b-be68c3cd237c tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:44.729264 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-aec3bd74-440f-4867-914b-be68c3cd237c tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:44.729693 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-aec3bd74-440f-4867-914b-be68c3cd237c tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:44.748028 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:52:44.866184 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-aec3bd74-440f-4867-914b-be68c3cd237c tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:52:44.874022 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-aec3bd74-440f-4867-914b-be68c3cd237c tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1575 microversion: 2.1 time: 0.157870 Sep 25 04:52:44.880999 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 595/1260] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:52:44 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:52:44.932543 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-4379b232-2db8-49d1-a680-12fd605e670e req-7aa73fde-5fe9-4bd8-8b6d-0b201b526742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe8e79dd-3c8b-432d-aee1-0ca947d8affe", "name": "network-vif-plugged", "status": "completed", "tag": "2eced77b-cebd-4659-801e-16aa388746bd"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:52:44.943622 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-4379b232-2db8-49d1-a680-12fd605e670e req-7aa73fde-5fe9-4bd8-8b6d-0b201b526742 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:44.944104 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-4379b232-2db8-49d1-a680-12fd605e670e req-7aa73fde-5fe9-4bd8-8b6d-0b201b526742 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:44.944545 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-4379b232-2db8-49d1-a680-12fd605e670e req-7aa73fde-5fe9-4bd8-8b6d-0b201b526742 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:44.956198 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-4379b232-2db8-49d1-a680-12fd605e670e req-7aa73fde-5fe9-4bd8-8b6d-0b201b526742 service nova] Creating event network-vif-plugged:2eced77b-cebd-4659-801e-16aa388746bd for instance fe8e79dd-3c8b-432d-aee1-0ca947d8affe on hv-cinder-85535 Sep 25 04:52:44.961610 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-4379b232-2db8-49d1-a680-12fd605e670e req-7aa73fde-5fe9-4bd8-8b6d-0b201b526742 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032546 Sep 25 04:52:44.962208 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 666/1261] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:52:45.897473 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-a5feea99-2cc1-4544-bf11-80a0913d8b1d tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:52:45.898084 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-a5feea99-2cc1-4544-bf11-80a0913d8b1d tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:52:45.904559 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a5feea99-2cc1-4544-bf11-80a0913d8b1d tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:45.905597 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a5feea99-2cc1-4544-bf11-80a0913d8b1d tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:45.906047 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a5feea99-2cc1-4544-bf11-80a0913d8b1d tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:45.906732 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a5feea99-2cc1-4544-bf11-80a0913d8b1d tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:45.907190 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a5feea99-2cc1-4544-bf11-80a0913d8b1d tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:45.907618 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-a5feea99-2cc1-4544-bf11-80a0913d8b1d tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:46.036283 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-a5feea99-2cc1-4544-bf11-80a0913d8b1d tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:52:46.044275 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-a5feea99-2cc1-4544-bf11-80a0913d8b1d tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1575 microversion: 2.1 time: 0.150649 Sep 25 04:52:46.044806 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 596/1262] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:52:45 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:52:47.068620 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-800c60dc-2cb7-4205-9ddf-2e14c6b324c2 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:52:47.069345 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-800c60dc-2cb7-4205-9ddf-2e14c6b324c2 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:52:47.071330 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:52:47.077506 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-800c60dc-2cb7-4205-9ddf-2e14c6b324c2 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:47.078107 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-800c60dc-2cb7-4205-9ddf-2e14c6b324c2 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:47.078546 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-800c60dc-2cb7-4205-9ddf-2e14c6b324c2 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:47.079229 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-800c60dc-2cb7-4205-9ddf-2e14c6b324c2 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:52:47.079677 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-800c60dc-2cb7-4205-9ddf-2e14c6b324c2 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:52:47.080135 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-800c60dc-2cb7-4205-9ddf-2e14c6b324c2 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:52:47.083164 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:52:47.214908 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-800c60dc-2cb7-4205-9ddf-2e14c6b324c2 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:52:47.223223 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-800c60dc-2cb7-4205-9ddf-2e14c6b324c2 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1562 microversion: 2.1 time: 0.159285 Sep 25 04:52:47.223813 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 667/1263] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:52:47 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:54:15.556357 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_api:SELECT=1 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:54:15.557128 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG dbcounter [-] [127142] Writing DB stats nova_cell1:SELECT=5 {{(pid=127142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:54:15.564411 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 25 04:54:15.564996 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: Sun Sep 25 04:54:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe (ip 10.222.0.25) !!! Sep 25 04:54:15.566516 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_api:SELECT=32 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:54:15.566516 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG dbcounter [-] [127141] Writing DB stats nova_cell1:SELECT=8 {{(pid=127141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 04:54:15.571397 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-03c64de9-211e-47ad-9205-96682a827a24 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:54:15.571902 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-03c64de9-211e-47ad-9205-96682a827a24 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:54:15.581625 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-03c64de9-211e-47ad-9205-96682a827a24 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:54:15.582516 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-03c64de9-211e-47ad-9205-96682a827a24 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:54:15.582964 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-03c64de9-211e-47ad-9205-96682a827a24 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:54:15.583673 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-03c64de9-211e-47ad-9205-96682a827a24 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:54:15.584140 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-03c64de9-211e-47ad-9205-96682a827a24 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:54:15.584575 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-03c64de9-211e-47ad-9205-96682a827a24 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:54:15.613584 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-03c64de9-211e-47ad-9205-96682a827a24 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Going to try to terminate instance {{(pid=127141) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 04:54:15.635406 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-b4cc72ac-bb83-4600-a3c0-43f4b71958d3 req-030f4ccc-7294-433d-8263-6b8aa15135ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe8e79dd-3c8b-432d-aee1-0ca947d8affe", "tag": "2eced77b-cebd-4659-801e-16aa388746bd"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:54:15.645844 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-b4cc72ac-bb83-4600-a3c0-43f4b71958d3 req-030f4ccc-7294-433d-8263-6b8aa15135ae service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:54:15.646439 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-b4cc72ac-bb83-4600-a3c0-43f4b71958d3 req-030f4ccc-7294-433d-8263-6b8aa15135ae service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:54:15.646932 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-b4cc72ac-bb83-4600-a3c0-43f4b71958d3 req-030f4ccc-7294-433d-8263-6b8aa15135ae service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:54:15.659066 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-b4cc72ac-bb83-4600-a3c0-43f4b71958d3 req-030f4ccc-7294-433d-8263-6b8aa15135ae service nova] Creating event network-changed:2eced77b-cebd-4659-801e-16aa388746bd for instance fe8e79dd-3c8b-432d-aee1-0ca947d8affe on hv-cinder-85535 Sep 25 04:54:15.664254 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-b4cc72ac-bb83-4600-a3c0-43f4b71958d3 req-030f4ccc-7294-433d-8263-6b8aa15135ae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109378 Sep 25 04:54:15.665169 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 668/1264] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 04:54:15.696090 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-03c64de9-211e-47ad-9205-96682a827a24 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 204 len: 0 microversion: 2.1 time: 0.144102 Sep 25 04:54:15.696690 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 597/1265] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Sep 25 04:54:15 2022] DELETE /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 04:54:15.705538 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-62d15588-52c1-4cdf-8fb9-ad1b8709adde tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:54:15.706252 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-62d15588-52c1-4cdf-8fb9-ad1b8709adde tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:54:15.712916 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-62d15588-52c1-4cdf-8fb9-ad1b8709adde tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:54:15.713442 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-62d15588-52c1-4cdf-8fb9-ad1b8709adde tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:54:15.713888 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-62d15588-52c1-4cdf-8fb9-ad1b8709adde tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:54:15.714860 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-62d15588-52c1-4cdf-8fb9-ad1b8709adde tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:54:15.715328 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-62d15588-52c1-4cdf-8fb9-ad1b8709adde tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:54:15.715761 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-62d15588-52c1-4cdf-8fb9-ad1b8709adde tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:54:15.869022 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.policy [None req-62d15588-52c1-4cdf-8fb9-ad1b8709adde tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127142) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:54:15.877350 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-62d15588-52c1-4cdf-8fb9-ad1b8709adde tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1568 microversion: 2.1 time: 0.176163 Sep 25 04:54:15.877921 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 669/1266] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:54:15 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:54:16.901707 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-7164c137-2205-4fc1-be57-a73a1d69aa37 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:54:16.902594 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-7164c137-2205-4fc1-be57-a73a1d69aa37 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:54:16.909471 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7164c137-2205-4fc1-be57-a73a1d69aa37 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:54:16.909970 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7164c137-2205-4fc1-be57-a73a1d69aa37 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:54:16.910412 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7164c137-2205-4fc1-be57-a73a1d69aa37 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:54:16.911279 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7164c137-2205-4fc1-be57-a73a1d69aa37 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:54:16.911741 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7164c137-2205-4fc1-be57-a73a1d69aa37 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:54:16.912173 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-7164c137-2205-4fc1-be57-a73a1d69aa37 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:54:17.091976 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-7164c137-2205-4fc1-be57-a73a1d69aa37 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:54:17.100034 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-7164c137-2205-4fc1-be57-a73a1d69aa37 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1568 microversion: 2.1 time: 0.202708 Sep 25 04:54:17.100597 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 598/1267] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:54:16 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1568 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 04:54:18.117856 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [req-742713d9-37f2-4def-9aac-d538c9d08f13 req-03c2af30-450b-412a-9ad3-216e28361ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe8e79dd-3c8b-432d-aee1-0ca947d8affe", "name": "network-vif-deleted", "tag": "2eced77b-cebd-4659-801e-16aa388746bd"}]} {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 04:54:18.124107 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-eac3f8b9-5ff4-4f31-adb4-7cc03377eb5a tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:54:18.124771 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.compute.api [None req-eac3f8b9-5ff4-4f31-adb4-7cc03377eb5a tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127141) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:54:18.128900 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-742713d9-37f2-4def-9aac-d538c9d08f13 req-03c2af30-450b-412a-9ad3-216e28361ce7 service nova] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:54:18.129408 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-742713d9-37f2-4def-9aac-d538c9d08f13 req-03c2af30-450b-412a-9ad3-216e28361ce7 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:54:18.129846 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [req-742713d9-37f2-4def-9aac-d538c9d08f13 req-03c2af30-450b-412a-9ad3-216e28361ce7 service nova] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:54:18.131079 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-eac3f8b9-5ff4-4f31-adb4-7cc03377eb5a tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:54:18.131572 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-eac3f8b9-5ff4-4f31-adb4-7cc03377eb5a tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:54:18.132238 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-eac3f8b9-5ff4-4f31-adb4-7cc03377eb5a tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:54:18.133217 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-eac3f8b9-5ff4-4f31-adb4-7cc03377eb5a tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:54:18.133930 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-eac3f8b9-5ff4-4f31-adb4-7cc03377eb5a tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:54:18.134434 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG oslo_concurrency.lockutils [None req-eac3f8b9-5ff4-4f31-adb4-7cc03377eb5a tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:54:18.152356 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.compute.server_external_events [req-742713d9-37f2-4def-9aac-d538c9d08f13 req-03c2af30-450b-412a-9ad3-216e28361ce7 service nova] Creating event network-vif-deleted:2eced77b-cebd-4659-801e-16aa388746bd for instance fe8e79dd-3c8b-432d-aee1-0ca947d8affe on hv-cinder-85535 Sep 25 04:54:18.158214 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [req-742713d9-37f2-4def-9aac-d538c9d08f13 req-03c2af30-450b-412a-9ad3-216e28361ce7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044174 Sep 25 04:54:18.158904 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 670/1268] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Sep 25 04:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 04:54:18.198887 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.policy [None req-eac3f8b9-5ff4-4f31-adb4-7cc03377eb5a tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673b4f55a335484d927d7966d72690ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981336000334d7d8451feaacc75da99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127141) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 04:54:18.207397 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-eac3f8b9-5ff4-4f31-adb4-7cc03377eb5a tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 200 len: 1383 microversion: 2.1 time: 0.087733 Sep 25 04:54:18.207964 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 599/1269] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:54:18 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 1383 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 04:54:19.232396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-a096ccb4-865b-47c8-bebd-2dc4fffde557 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '>' {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:54:19.233096 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.compute.api [None req-a096ccb4-865b-47c8-bebd-2dc4fffde557 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] [instance: fe8e79dd-3c8b-432d-aee1-0ca947d8affe] Fetching instance by UUID {{(pid=127142) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 04:54:19.239282 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a096ccb4-865b-47c8-bebd-2dc4fffde557 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:54:19.239766 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a096ccb4-865b-47c8-bebd-2dc4fffde557 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:54:19.240205 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a096ccb4-865b-47c8-bebd-2dc4fffde557 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:54:19.240922 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a096ccb4-865b-47c8-bebd-2dc4fffde557 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Acquiring lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 04:54:19.241376 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a096ccb4-865b-47c8-bebd-2dc4fffde557 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 04:54:19.241801 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG oslo_concurrency.lockutils [None req-a096ccb4-865b-47c8-bebd-2dc4fffde557 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Lock "adc1fa50-82a8-468b-9dc8-c203e45a28ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 04:54:19.255086 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.wsgi [None req-a096ccb4-865b-47c8-bebd-2dc4fffde557 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] HTTP exception thrown: Instance fe8e79dd-3c8b-432d-aee1-0ca947d8affe could not be found. Sep 25 04:54:19.256691 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-a096ccb4-865b-47c8-bebd-2dc4fffde557 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Request method failure captured: Sep 25 04:54:19.256691 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: request: GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe HTTP/1.1 Sep 25 04:54:19.256691 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept: application/json Sep 25 04:54:19.256691 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Accept-Encoding: identity Sep 25 04:54:19.256691 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Connection: close Sep 25 04:54:19.256691 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Length: 0 Sep 25 04:54:19.256691 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Content-Type: application/json Sep 25 04:54:19.256691 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Host: 10.222.0.25 Sep 25 04:54:19.256691 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: Openstack-System-Scope: None Sep 25 04:54:19.256691 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: User-Agent: python-urllib3/1.26.12 Sep 25 04:54:19.256691 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Auth-Token: gAAAAABjL92uwIG4ymJ6bBL1xF_qeio_0uPz_SIvnwGmpfA7iISJo_QZ6O2zgu4LZjDce1aXhd28FPF80EjzQCFuJgeXfmJzS6FZPvVHu0Jur_C5Y7g8NyMzP4-rQiHcBEzcsVI_qsNtt6bit6Z4cekT1O0SBAVwbbXNUWlEWMng9Eoh97_3lbg Sep 25 04:54:19.256691 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Id: None Sep 25 04:54:19.256691 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Domain-Name: None Sep 25 04:54:19.256691 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Identity-Status: Confirmed Sep 25 04:54:19.256691 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Is-Admin-Project: True Sep 25 04:54:19.256691 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Id: default Sep 25 04:54:19.256691 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Domain-Name: Default Sep 25 04:54:19.256691 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Id: b981336000334d7d8451feaacc75da99 Sep 25 04:54:19.256691 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Project-Name: tempest-TestShelveInstance-1388292841 Sep 25 04:54:19.256691 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Role: reader,member Sep 25 04:54:19.256691 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Roles: reader,member Sep 25 04:54:19.258518 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b981336000334d7d8451feaacc75da99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b981336000334d7d8451feaacc75da99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b981336000334d7d8451feaacc75da99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b981336000334d7d8451feaacc75da99"}]}] Sep 25 04:54:19.258518 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant: tempest-TestShelveInstance-1388292841 Sep 25 04:54:19.258518 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Id: b981336000334d7d8451feaacc75da99 Sep 25 04:54:19.258518 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-Tenant-Name: tempest-TestShelveInstance-1388292841 Sep 25 04:54:19.258518 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User: tempest-TestShelveInstance-1388292841-project Sep 25 04:54:19.258518 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Id: default Sep 25 04:54:19.258518 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Domain-Name: Default Sep 25 04:54:19.258518 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Id: 673b4f55a335484d927d7966d72690ad Sep 25 04:54:19.258518 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: X-User-Name: tempest-TestShelveInstance-1388292841-project Sep 25 04:54:19.258518 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: method: > Sep 25 04:54:19.258518 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: exception: Instance fe8e79dd-3c8b-432d-aee1-0ca947d8affe could not be found. Sep 25 04:54:19.258518 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: action_args: {'id': 'fe8e79dd-3c8b-432d-aee1-0ca947d8affe'} Sep 25 04:54:19.259601 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: {{(pid=127142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 04:54:19.259601 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:54:19.259601 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 04:54:19.259601 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 04:54:19.259601 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 04:54:19.259601 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 04:54:19.259601 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 04:54:19.259601 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 04:54:19.259601 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 04:54:19.259601 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 04:54:19.259601 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe8e79dd-3c8b-432d-aee1-0ca947d8affe could not be found. Sep 25 04:54:19.259601 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:54:19.259601 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:54:19.259601 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:54:19.259601 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:54:19.259601 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:54:19.259601 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:54:19.259601 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 04:54:19.259601 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 04:54:19.259601 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 04:54:19.261396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 04:54:19.261396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 04:54:19.261396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 04:54:19.261396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 04:54:19.261396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 04:54:19.261396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 04:54:19.261396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 04:54:19.261396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe8e79dd-3c8b-432d-aee1-0ca947d8affe could not be found. Sep 25 04:54:19.261396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:54:19.261396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 04:54:19.261396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:54:19.261396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 04:54:19.261396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 04:54:19.261396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 04:54:19.261396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 04:54:19.261396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 04:54:19.261396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe8e79dd-3c8b-432d-aee1-0ca947d8affe could not be found. Sep 25 04:54:19.261396 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: ERROR nova.api.openstack.wsgi Sep 25 04:54:19.262941 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: DEBUG nova.api.openstack.wsgi [None req-a096ccb4-865b-47c8-bebd-2dc4fffde557 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Returning 404 to user: Instance fe8e79dd-3c8b-432d-aee1-0ca947d8affe could not be found. {{(pid=127142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 04:54:19.262941 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: INFO nova.api.openstack.requestlog [None req-a096ccb4-865b-47c8-bebd-2dc4fffde557 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe" status: 404 len: 111 microversion: 2.1 time: 0.030491 Sep 25 04:54:19.262941 dv-cinder-855359-5-iscsi devstack@n-api.service[127142]: [pid: 127142|app: 0|req: 671/1270] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Sep 25 04:54:19 2022] GET /compute/v2.1/servers/fe8e79dd-3c8b-432d-aee1-0ca947d8affe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 04:54:19.419316 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: DEBUG nova.api.openstack.wsgi [None req-8233cbf2-5826-4fe5-8903-a566fca5a768 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] Calling method '.version_select at 0x7f4d3ef24430>' {{(pid=127141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 04:54:19.443845 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: INFO nova.api.openstack.requestlog [None req-8233cbf2-5826-4fe5-8903-a566fca5a768 tempest-TestShelveInstance-1388292841 tempest-TestShelveInstance-1388292841-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1260319028" status: 202 len: 0 microversion: 2.1 time: 0.028504 Sep 25 04:54:19.444774 dv-cinder-855359-5-iscsi devstack@n-api.service[127141]: [pid: 127141|app: 0|req: 600/1271] 10.222.0.25 () {58 vars in 1254 bytes} [Sun Sep 25 04:54:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1260319028 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)